Jul 17 03:33:15 devstack cinder-volume[76270]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 17 03:33:15 devstack cinder-volume[76270]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 17 03:33:15 devstack cinder-volume[76270]: we strongly recommend against using it for new projects.
Jul 17 03:33:15 devstack cinder-volume[76270]: If you are already using Eventlet, we recommend migrating to a different
Jul 17 03:33:15 devstack cinder-volume[76270]: framework.  For more detail see
Jul 17 03:33:15 devstack cinder-volume[76270]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 17 03:33:15 devstack cinder-volume[76270]:   import eventlet  # noqa
Jul 17 03:33:18 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 17 03:33:18 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 17 03:33:18 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 17 03:33:18 devstack cinder-volume[76270]: INFO dbcounter [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Registered counter for database cinder
Jul 17 03:33:19 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:33:19 devstack cinder-volume[76270]: DEBUG dbcounter [-] [76270] Writer thread running {{(pid=76270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 17 03:33:19 devstack cinder-volume[76270]: INFO cinder.rpc [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 17 03:33:19 devstack cinder-volume[76270]: INFO cinder.rpc [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 17 03:33:19 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:33:19 devstack cinder-volume[76270]: INFO cinder.volume.manager [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Determined volume DB was empty at startup.
Jul 17 03:33:19 devstack cinder-volume[76270]: DEBUG cinder.volume.manager [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76270) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 17 03:33:19 devstack cinder-volume[76270]: INFO cinder.volume.manager [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 17 03:33:19 devstack cinder-volume[76270]: WARNING stevedore.named [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 17 03:33:19 devstack cinder-volume[76270]: WARNING castellan.key_manager [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 17 03:33:19 devstack cinder-volume[76270]: WARNING cinder.keymgr.conf_key_mgr [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 17 03:33:19 devstack cinder-volume[76270]: DEBUG cinder.volume.drivers.lvm [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76270) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Jul 17 03:33:19 devstack cinder-volume[76270]: DEBUG oslo_concurrency.processutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:19 devstack cinder-volume[76270]: DEBUG oslo_concurrency.processutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] CMD "cinder-rtstool verify" returned: 0 in 0.506s {{(pid=76270) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:33:20 devstack cinder-volume[76270]: INFO cinder.rpc [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 17 03:33:20 devstack cinder-volume[76270]: INFO cinder.rpc [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 17 03:33:20 devstack cinder-volume[76270]: WARNING stevedore.named [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 17 03:33:20 devstack cinder-volume[76270]: WARNING castellan.key_manager [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 17 03:33:20 devstack cinder-volume[76270]: INFO cinder.volume.manager [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_db.sqlalchemy.engines [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76270) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:33:20 devstack cinder-volume[76270]: INFO oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Starting 1 workers
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Started child 76424 {{(pid=76270) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Full set of CONF: {{(pid=76270) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] ******************************************************************************** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Configuration options gathered from: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] ================================================================================ {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] allow_availability_zone_fallback = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] allow_compression_on_image_upload = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] allowed_direct_url_schemes     = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] api_rate_limit                 = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] auth_strategy                  = keystone {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] az_cache_duration              = 3600 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_availability_zone      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_host                   = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_name                   = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_stats_polling_interval = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backup_api_class               = cinder.backup.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backup_name_template           = backup-%s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backup_use_same_host           = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backup_use_temp_snapshot       = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76424]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] chap_password                  = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] chap_username                  =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_internal_tenant_project_id = 9ddd5c6aadcb4becbf7cc8868485851c {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_internal_tenant_user_id = 1d3f51d21f914cb3a3afdb76840051b9 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cloned_volume_same_az          = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cluster                        = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] compression_format             = gzip {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] config_dir                     = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] config_source                  = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] control_exchange               = openstack {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] debug                          = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] default_availability_zone      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] default_group_type             = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] default_volume_type            = lvmdriver-1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] disk_geometry                  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] driver_client_cert             = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] driver_client_cert_key         = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] driver_data_namespace          = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] driver_ssl_cert_path           = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] driver_ssl_cert_verify         = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] driver_use_ssl                 = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] enable_force_upload            = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] enable_new_services            = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] enable_unsupported_driver      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] enforce_multipath_for_image_xfer = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] filter_function                = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_api_insecure            = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_api_servers             = ['http://192.168.122.37/image'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_api_ssl_compression     = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_ca_certificates_file    = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_certfile                = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_keyfile                 = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_num_retries             = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance_request_timeout         = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] goodness_function              = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] graceful_shutdown_timeout      = 5 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] group_api_class                = cinder.group.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] host                           = devstack {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_compress_on_upload       = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_conversion_address_space_limit = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_conversion_cpu_limit     = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_conversion_disable       = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_upload_use_cinder_backend = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_upload_use_internal_tenant = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_volume_cache_enabled     = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_volume_cache_max_count   = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] image_volume_cache_max_size_gb = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] init_host_max_objects_retrieval = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] iscsi_target_flags             =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] iscsi_write_cache              = on {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] iser_helper                    = tgtadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] iser_ip_address                = 192.168.122.37 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] iser_port                      = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_color                      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_config_append              = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_dir                        = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_file                       = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_options                    = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_rotate_interval            = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_rotate_interval_type       = days {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] log_rotation_type              = none {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] max_age                        = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] max_logfile_count              = 30 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] max_logfile_size_mb            = 200 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] max_over_subscription_ratio    = 20.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] message_reap_interval          = 86400 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] message_ttl                    = 2592000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] migration_create_volume_timeout_secs = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] monkey_patch                   = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] monkey_patch_modules           = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] my_ip                          = 192.168.122.37 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] no_snapshot_gb_quota           = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] num_iser_scan_tries            = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76424]: INFO cinder.volume.manager [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] num_shell_tries                = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] num_volume_device_scan_tries   = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] nvmeof_conn_info_version       = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] nvmet_ns_id                    = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] nvmet_port_id                  = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] osapi_max_limit                = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] osapi_volume_ext_list          = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] osapi_volume_listen_port       = 8776 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] osapi_volume_use_ssl           = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] osapi_volume_workers           = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] per_volume_size_limit          = -1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] periodic_fuzzy_delay           = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] periodic_interval              = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] public_endpoint                = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] publish_errors                 = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] quota_backup_gigabytes         = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] quota_backups                  = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] quota_gigabytes                = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] quota_groups                   = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] quota_snapshots                = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] quota_volumes                  = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] rate_limit_burst               = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] rate_limit_except_level        = CRITICAL {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] rate_limit_interval            = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] reinit_driver_count            = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] replication_device             = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] report_discard_supported       = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] report_interval                = 120 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] reservation_clean_interval     = 86400 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] reservation_expire             = 86400 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] reserved_image_namespaces      = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] reserved_percentage            = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] rpc_response_timeout           = 120 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] run_external_periodic_tasks    = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] scst_target_driver             = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] scst_target_iqn_name           = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_down_time              = 720 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] shell_completion               = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] snapshot_name_template         = snapshot-%s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] snapshot_same_host             = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] split_loggers                  = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] state_path                     = /opt/stack/data/cinder {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] storage_availability_zone      = nova {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] storage_protocol               = iSCSI {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] syslog_log_facility            = LOG_USER {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] target_helper                  = lioadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] target_ip_address              = 192.168.122.37 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] target_port                    = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] target_protocol                = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] target_secondary_ip_addresses  = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] trace_flags                    = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] transport_url                  = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] until_refresh                  = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] use_chap_auth                  = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] use_default_quota_class        = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] use_journal                    = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] use_json                       = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] use_multipath_for_image_xfer   = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] use_stderr                     = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] use_syslog                     = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] verify_glance_signatures       = enabled {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_api_class               = cinder.volume.api.API {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_backend_name            = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_clear                   = zero {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_clear_ionice            = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_clear_size              = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_copy_bps_limit          = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_dd_blocksize            = 1M {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_name_template           = volume-%s {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_service_inithost_offload = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volume_usage_audit_period      = month {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] zoning_mode                    = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_concurrency.disable_process_locking = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.auth_section = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.auth_type   = password {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.auth_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.cache       = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.certfile    = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.include_service_catalog = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.insecure    = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.interface   = public {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.keyfile     = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_password =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcache_username =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.region_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.service_type = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.37/identity {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.backend                  = dogpile.cache.null {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.backend_argument         = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.backend_expiration_time  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.config_prefix            = cache.oslo {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.debug_cache_backend      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.enable_retry_client      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.enable_socket_keepalive  = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.enabled                  = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.expiration_time          = 600 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.hashclient_retry_attempts = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.memcache_dead_retry      = 300 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.memcache_sasl_enabled    = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.password                 = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.proxies                  = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.redis_db                 = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.redis_server             = localhost:6379 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.retry_attempts           = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.retry_delay              = 0.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.socket_keepalive_count   = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.socket_keepalive_idle    = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.socket_keepalive_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.socket_timeout           = 1.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.tls_allowed_ciphers      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.tls_cafile               = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.tls_certfile             = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.tls_enabled              = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.tls_keyfile              = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cache.username                 = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] coordination.backend_url       = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.asyncio_connection    = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.asyncio_slave_connection = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.backend               = sqlalchemy {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.connection            = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.connection_debug      = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.connection_parameters =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.connection_recycle_time = 3600 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.connection_trace      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.db_inc_retry_interval = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.db_max_retries        = 20 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.db_max_retry_interval = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.db_retry_interval     = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.max_overflow          = 50 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.max_pool_size         = 5 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.max_retries           = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.mysql_wsrep_sync_wait = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.pool_timeout          = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.retry_interval        = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.slave_connection      = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.sqlite_synchronous    = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.synchronous_reader    = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] database.use_db_reconnect      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.connection_string     = messaging:// {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack sudo[76469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.enabled               = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.es_doc_type           = notification {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack sudo[76469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.es_scroll_size        = 10000 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.es_scroll_time        = 2m {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.filter_error_trace    = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.hmac_keys             = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.sentinel_service_name = mymaster {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.socket_timeout        = 0.1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.trace_requests        = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler.trace_sqlalchemy      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler_jaeger.process_tags   = {} {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler_jaeger.service_name_prefix = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] profiler_otlp.service_name_prefix = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.enforce_new_defaults = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.policy_default_rule = default {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] privsep_osbrick.group          = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] privsep_osbrick.helper_command = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] privsep_osbrick.user           = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_sys_admin.group         = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_sys_admin.helper_command = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] cinder_sys_admin.user          = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.auth_section      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.auth_type         = password {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.cafile            = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.certfile          = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.collect_timing    = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.insecure          = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.keyfile           = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.send_service_user_token = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.split_loggers     = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] service_user.timeout           = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.auth_section            = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.auth_type               = password {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.certfile                = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.collect_timing          = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.insecure                = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.keyfile                 = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.region_name             = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.split_loggers           = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] glance.timeout                 = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.backend_availability_zone = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.chap_password = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.chap_username =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.disk_geometry = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.driver_client_cert = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.driver_client_cert_key = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.driver_data_namespace = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.driver_use_ssl = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.extra_capabilities = {} {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.filter_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.goodness_function = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.iscsi_target_flags =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.iscsi_write_cache = on {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.iser_ip_address = 192.168.122.37 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.iser_port     = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.lvm_share_target = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.lvm_type      = auto {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.num_shell_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.replication_device = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.report_discard_supported = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.reserved_percentage = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.target_helper = tgtadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.target_ip_address = 192.168.122.37 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.target_port   = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.target_protocol = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.trace_flags   = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.unique_fqdn_network = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.use_chap_auth = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_backend_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_clear  = zero {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_clear_ionice = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_clear_size = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_reports.file_event_handler = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_reports.log_dir           = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.backend_host       = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.chap_password      = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.chap_username      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.disk_geometry      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.driver_client_cert = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.extra_capabilities = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.filter_function    = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.goodness_function  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.iser_helper        = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.iser_port          = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.lvm_type           = auto {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.replication_device = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.report_discard_supported = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.reserved_percentage = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.scst_target_driver = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.storage_protocol   = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.target_ip_address  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.target_port        = 3260 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.trace_flags        = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_clear       = zero {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] lvmdriver-1.volumes_dir        = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_notifications.driver = [] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_notifications.retry = -1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] key_manager.fixed_key          = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.barbican_api_version  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.barbican_endpoint     = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.barbican_endpoint_type = public {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.barbican_region_name  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.cafile                = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.certfile              = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.collect_timing        = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.insecure              = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.keyfile               = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.number_of_retries     = 60 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.retry_delay           = 1 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.send_service_user_token = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.split_loggers         = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.timeout               = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.verify_ssl            = True {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican.verify_ssl_path       = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.auth_section = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.auth_type = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.cafile   = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.certfile = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.collect_timing = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.insecure = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.keyfile  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.split_loggers = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] barbican_service_user.timeout  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.approle_role_id          = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.approle_secret_id        = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.auth_method              = approle {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.auth_path                = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.kv_mountpoint            = secret {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.kv_path                  = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.kv_version               = 2 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.namespace                = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.root_token_id            = **** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.ssl_ca_crt_file          = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.timeout                  = 60.0 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.token_file               = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.token_role               = None {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.use_ssl                  = False {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:33:20 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] ******************************************************************************** {{(pid=76270) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 17 03:33:20 devstack sudo[76469]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:20 devstack sudo[76590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:20 devstack sudo[76590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:20 devstack sudo[76590]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.270s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:33:20 devstack cinder-volume[76424]: INFO cinder.brick.local_dev.lvm [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:20 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:20 devstack sudo[76696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:33:20 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:21 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:21 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:21 devstack cinder-volume[76424]: DEBUG cinder.brick.local_dev.lvm [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76424) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Jul 17 03:33:21 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:21 devstack sudo[76784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:21 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:21 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:21 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.596s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:21 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:21 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:21 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:21 devstack sudo[77061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:21 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:22 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:22 devstack sudo[77068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 17 03:33:22 devstack sudo[77068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:22 devstack sudo[77068]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.358s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:22 devstack sudo[77150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:33:22 devstack sudo[77150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:22 devstack sudo[77150]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:22 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:22 devstack sudo[77159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:33:22 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:23 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:23 devstack sudo[77216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:33:23 devstack sudo[77216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:23 devstack sudo[77216]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:23 devstack sudo[77245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:23 devstack sudo[77245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:23 devstack sudo[77245]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:23 devstack sudo[77249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:23 devstack sudo[77249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:23 devstack sudo[77249]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:23 devstack cinder-volume[76424]: INFO cinder.volume.drivers.lvm [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:23 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:23 devstack sudo[77253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:23 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:24 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG cinder.volume.drivers.lvm [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Updating volume stats {{(pid=76424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:24 devstack sudo[77256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:33:24 devstack sudo[77256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:24 devstack sudo[77256]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:24 devstack sudo[77259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:33:24 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:24 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:24 devstack sudo[77262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:24 devstack sudo[77262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:24 devstack sudo[77262]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:24 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:24 devstack sudo[77266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:33:25 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:25 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:25 devstack cinder-volume[76424]: INFO cinder.volume.driver [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Driver hasn't implemented _init_vendor_properties()
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG cinder.volume.driver [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76424) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG oslo_db.sqlalchemy.engines [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76424) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG dbcounter [-] [76424] Writer thread running {{(pid=76424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG cinder.db.api [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Building query based on filter {{(pid=76424) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG cinder.image.image_utils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76424) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 17 03:33:25 devstack cinder-volume[76424]: INFO cinder.keymgr.migration [None req-843616ee-a23c-4af4-95c1-277c70db1597 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG cinder.volume.drivers.lvm [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Updating volume stats {{(pid=76424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:25 devstack sudo[77278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:33:25 devstack sudo[77278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:25 devstack sudo[77278]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:25 devstack sudo[77281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:33:25 devstack sudo[77281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:25 devstack sudo[77281]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:25 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:25 devstack sudo[77285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:25 devstack sudo[77285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:26 devstack sudo[77285]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:26 devstack sudo[77289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:33:26 devstack sudo[77289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:26 devstack sudo[77289]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG cinder.manager [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Notifying Schedulers of capabilities ... {{(pid=76424) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:33:26 devstack cinder-volume[76424]: INFO cinder.volume.manager [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Driver initialization completed successfully.
Jul 17 03:33:26 devstack cinder-volume[76424]: INFO cinder.manager [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Initiating service 2 cleanup
Jul 17 03:33:26 devstack cinder-volume[76424]: INFO cinder.manager [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Service 2 cleanup completed.
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG cinder.service [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Creating RPC server for service cinder-volume {{(pid=76424) start /opt/stack/cinder/cinder/service.py:231}}
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG cinder.service [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76424) start /opt/stack/cinder/cinder/service.py:237}}
Jul 17 03:33:26 devstack cinder-volume[76424]: INFO cinder.volume.manager [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG cinder.volume.drivers.lvm [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Updating volume stats {{(pid=76424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:26 devstack sudo[77292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:33:26 devstack sudo[77292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:26 devstack sudo[77292]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:26 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:26 devstack sudo[77295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:33:26 devstack sudo[77295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:27 devstack sudo[77295]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:27 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:27 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:27 devstack sudo[77298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:33:27 devstack sudo[77298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:27 devstack sudo[77298]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:27 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:27 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:33:27 devstack sudo[77302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:33:27 devstack sudo[77302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:33:27 devstack sudo[77302]: pam_unix(sudo:session): session closed for user root
Jul 17 03:33:27 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:33:27 devstack cinder-volume[76424]: INFO cinder.volume.manager [None req-5b305f65-b032-4db0-9acf-3d6bfdb063af None None] Driver post RPC initialization completed successfully.
Jul 17 03:33:30 devstack cinder-volume[76270]: DEBUG dbcounter [-] [76270] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76270) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:33:37 devstack cinder-volume[76424]: DEBUG dbcounter [-] [76424] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:33:37 devstack cinder-volume[76424]: DEBUG dbcounter [-] [76424] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:34:01 devstack cinder-volume[76424]: DEBUG oslo_service.periodic_task [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running periodic task VolumeManager._thread_info {{(pid=76424) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:34:01 devstack cinder-volume[76424]: DEBUG cinder.volume.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] thread count: 6 {{(pid=76424) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:34:01 devstack cinder-volume[76424]: DEBUG cinder.volume.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] thread info: [<_MainThread(MainThread, started 123724512198784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123724403399744)>, <Thread(Thread-3 (stat_writer), started daemon 123724401184320)>, <Thread(Rabbit-heartbeat, started daemon 123724402265792)>, <Thread(Thread-5 (_runner), started daemon 123724400044544)>, <Thread(Thread-7 (_runner), started daemon 123724400060032)>] {{(pid=76424) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:35:01 devstack cinder-volume[76424]: DEBUG oslo_service.periodic_task [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76424) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:35:01 devstack cinder-volume[76424]: DEBUG cinder.volume.drivers.lvm [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Updating volume stats {{(pid=76424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 17 03:35:01 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:35:01 devstack sudo[81596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:35:01 devstack sudo[81596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:35:02 devstack sudo[81596]: pam_unix(sudo:session): session closed for user root
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:35:02 devstack sudo[81737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:35:02 devstack sudo[81737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:35:02 devstack sudo[81737]: pam_unix(sudo:session): session closed for user root
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:35:02 devstack sudo[81893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:35:02 devstack sudo[81893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:35:02 devstack sudo[81893]: pam_unix(sudo:session): session closed for user root
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:35:02 devstack sudo[82062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:35:02 devstack sudo[82062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:35:02 devstack sudo[82062]: pam_unix(sudo:session): session closed for user root
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG cinder.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Notifying Schedulers of capabilities ... {{(pid=76424) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG oslo_service.periodic_task [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running periodic task VolumeManager._thread_info {{(pid=76424) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG cinder.volume.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] thread count: 6 {{(pid=76424) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:35:02 devstack cinder-volume[76424]: DEBUG cinder.volume.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] thread info: [<_MainThread(MainThread, started 123724512198784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123724403399744)>, <Thread(Thread-3 (stat_writer), started daemon 123724401184320)>, <Thread(Rabbit-heartbeat, started daemon 123724402265792)>, <Thread(Thread-5 (_runner), started daemon 123724400044544)>, <Thread(Thread-7 (_runner), started daemon 123724400060032)>] {{(pid=76424) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:35:37 devstack cinder-volume[76424]: DEBUG dbcounter [-] [76424] Writing DB stats cinder:SELECT=1 {{(pid=76424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:35:37 devstack cinder-volume[76424]: DEBUG dbcounter [-] [76424] Writing DB stats cinder:UPDATE=1 {{(pid=76424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:36:01 devstack cinder-volume[76424]: DEBUG oslo_service.periodic_task [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76424) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:36:01 devstack cinder-volume[76424]: DEBUG cinder.volume.drivers.lvm [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Updating volume stats {{(pid=76424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 17 03:36:01 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:36:01 devstack sudo[83852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:36:01 devstack sudo[83852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:36:02 devstack sudo[83852]: pam_unix(sudo:session): session closed for user root
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:36:02 devstack sudo[83880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:36:02 devstack sudo[83880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:36:02 devstack sudo[83880]: pam_unix(sudo:session): session closed for user root
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:36:02 devstack sudo[83884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:36:02 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:36:02 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:36:02 devstack sudo[83902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:36:02 devstack sudo[83902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:36:02 devstack sudo[83902]: pam_unix(sudo:session): session closed for user root
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG cinder.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Notifying Schedulers of capabilities ... {{(pid=76424) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG oslo_service.periodic_task [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running periodic task VolumeManager._thread_info {{(pid=76424) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG cinder.volume.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] thread count: 6 {{(pid=76424) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:36:02 devstack cinder-volume[76424]: DEBUG cinder.volume.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] thread info: [<_MainThread(MainThread, started 123724512198784)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123724403399744)>, <Thread(Thread-3 (stat_writer), started daemon 123724401184320)>, <Thread(Rabbit-heartbeat, started daemon 123724402265792)>, <Thread(Thread-5 (_runner), started daemon 123724400044544)>, <Thread(Thread-7 (_runner), started daemon 123724400060032)>] {{(pid=76424) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:37:01 devstack cinder-volume[76424]: DEBUG oslo_service.periodic_task [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76424) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:37:01 devstack cinder-volume[76424]: DEBUG cinder.volume.drivers.lvm [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Updating volume stats {{(pid=76424) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Jul 17 03:37:01 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:37:01 devstack sudo[85371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 17 03:37:01 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:37:02 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:37:02 devstack sudo[85374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:37:02 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:37:02 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:37:02 devstack sudo[85389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 17 03:37:02 devstack sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:37:02 devstack sudo[85389]: pam_unix(sudo:session): session closed for user root
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:37:02 devstack sudo[85392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 17 03:37:02 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:37:02 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG oslo_concurrency.processutils [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76424) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:37:02 devstack cinder-volume[76424]: DEBUG cinder.manager [None req-372c0473-18e8-4232-b09b-fcdc1f46474e None None] Notifying Schedulers of capabilities ... {{(pid=76424) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:37:37 devstack cinder-volume[76424]: DEBUG dbcounter [-] [76424] Writing DB stats cinder:SELECT=1 {{(pid=76424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:37:37 devstack cinder-volume[76424]: DEBUG dbcounter [-] [76424] Writing DB stats cinder:UPDATE=1 {{(pid=76424) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:37:55 devstack cinder-volume[76270]: INFO oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Caught SIGTERM, stopping children
Jul 17 03:37:55 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Acquiring lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 17 03:37:55 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Acquired lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 17 03:37:55 devstack cinder-volume[76270]: DEBUG oslo_concurrency.lockutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Releasing lock "singleton_lock" {{(pid=76270) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 17 03:37:55 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Stop services. {{(pid=76270) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 17 03:37:55 devstack cinder-volume[76270]: DEBUG oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Killing children. {{(pid=76270) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 17 03:37:55 devstack cinder-volume[76270]: INFO oslo_service.backend._eventlet.service [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Waiting on 1 children to exit
Jul 17 03:38:00 devstack cinder-volume[76424]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 17 03:38:00 devstack cinder-volume[86532]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 17 03:38:00 devstack cinder-volume[86532]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 17 03:38:00 devstack cinder-volume[86532]: we strongly recommend against using it for new projects.
Jul 17 03:38:00 devstack cinder-volume[86532]: If you are already using Eventlet, we recommend migrating to a different
Jul 17 03:38:00 devstack cinder-volume[86532]: framework.  For more detail see
Jul 17 03:38:00 devstack cinder-volume[86532]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 17 03:38:00 devstack cinder-volume[86532]:   import eventlet  # noqa
Jul 17 03:38:01 devstack cinder-volume[76424]: DEBUG oslo_concurrency.lockutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Acquiring lock "singleton_lock" {{(pid=76424) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 17 03:38:01 devstack cinder-volume[76424]: DEBUG oslo_concurrency.lockutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Acquired lock "singleton_lock" {{(pid=76424) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 17 03:38:01 devstack cinder-volume[76424]: DEBUG oslo_concurrency.lockutils [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Releasing lock "singleton_lock" {{(pid=76424) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 17 03:38:01 devstack cinder-volume[76424]: WARNING amqp [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 17 03:38:01 devstack cinder-volume[76424]: WARNING amqp [None req-69f19757-138f-4e81-b545-4fa43fbb1d49 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 17 03:38:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 17 03:38:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 17 03:38:02 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 17 03:38:03 devstack cinder-volume[86532]: INFO dbcounter [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Registered counter for database cinder
Jul 17 03:38:03 devstack cinder-volume[86532]: DEBUG oslo_db.sqlalchemy.engines [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86532) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:03 devstack cinder-volume[86532]: DEBUG dbcounter [-] [86532] Writer thread running {{(pid=86532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 17 03:38:03 devstack cinder-volume[86532]: INFO cinder.rpc [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 17 03:38:03 devstack cinder-volume[86532]: INFO cinder.rpc [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 17 03:38:03 devstack cinder-volume[86532]: DEBUG oslo_db.sqlalchemy.engines [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86532) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:03 devstack cinder-volume[86532]: INFO cinder.volume.manager [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Determined volume DB was empty at startup.
Jul 17 03:38:03 devstack cinder-volume[86532]: DEBUG cinder.volume.manager [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86532) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 17 03:38:03 devstack cinder-volume[86532]: INFO cinder.volume.manager [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 17 03:38:03 devstack cinder-volume[86532]: WARNING stevedore.named [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 17 03:38:03 devstack cinder-volume[86532]: WARNING castellan.key_manager [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 17 03:38:03 devstack cinder-volume[86532]: WARNING cinder.keymgr.conf_key_mgr [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 17 03:38:03 devstack cinder-volume[86532]: INFO cinder.volume.manager [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_db.sqlalchemy.engines [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86532) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:04 devstack cinder-volume[86532]: INFO oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Starting 1 workers
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Started child 86754 {{(pid=86532) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Full set of CONF: {{(pid=86532) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] ******************************************************************************** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Configuration options gathered from: {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] ================================================================================ {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 17 03:38:04 devstack cinder-volume[86754]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] allow_availability_zone_fallback = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] allow_compression_on_image_upload = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] allowed_direct_url_schemes     = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] api_rate_limit                 = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] auth_strategy                  = keystone {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_availability_zone      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_host                   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_name                   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_stats_polling_interval = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backup_api_class               = cinder.backup.api.API {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backup_name_template           = backup-%s {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backup_use_same_host           = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backup_use_temp_snapshot       = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] chap_password                  = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] chap_username                  =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_internal_tenant_project_id = 9ddd5c6aadcb4becbf7cc8868485851c {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_internal_tenant_user_id = 1d3f51d21f914cb3a3afdb76840051b9 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cluster                        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] compression_format             = gzip {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] config_dir                     = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] config_source                  = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] control_exchange               = openstack {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] debug                          = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] default_availability_zone      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] default_group_type             = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] default_volume_type            = QuobyteHD {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] disk_geometry                  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] driver_client_cert             = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] driver_client_cert_key         = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] driver_data_namespace          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] driver_ssl_cert_path           = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] driver_ssl_cert_verify         = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] driver_use_ssl                 = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] enable_new_services            = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] enable_unsupported_driver      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] enforce_multipath_for_image_xfer = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] filter_function                = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_api_insecure            = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_api_servers             = ['http://192.168.122.37/image'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_api_ssl_compression     = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_ca_certificates_file    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_certfile                = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_keyfile                 = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_num_retries             = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance_request_timeout         = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] goodness_function              = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] graceful_shutdown_timeout      = 5 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] group_api_class                = cinder.group.api.API {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86754]: INFO cinder.volume.manager [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Starting volume driver QuobyteDriver (1.2)
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] host                           = devstack {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_compress_on_upload       = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_conversion_address_space_limit = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_conversion_cpu_limit     = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.remotefs [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86754) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_conversion_disable       = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_upload_use_cinder_backend = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_upload_use_internal_tenant = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_volume_cache_enabled     = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_volume_cache_max_count   = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] image_volume_cache_max_size_gb = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] init_host_max_objects_retrieval = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] iscsi_target_flags             =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] iscsi_write_cache              = on {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] iser_helper                    = tgtadm {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] iser_ip_address                = 192.168.122.37 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] iser_port                      = 3260 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_color                      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_config_append              = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_dir                        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_file                       = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_options                    = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_rotate_interval            = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_rotate_interval_type       = days {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] log_rotation_type              = none {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] max_age                        = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] max_logfile_count              = 30 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] max_logfile_size_mb            = 200 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] max_over_subscription_ratio    = 20.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] message_reap_interval          = 86400 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] message_ttl                    = 2592000 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] migration_create_volume_timeout_secs = 300 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] monkey_patch                   = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] monkey_patch_modules           = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] my_ip                          = 192.168.122.37 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] no_snapshot_gb_quota           = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] num_iser_scan_tries            = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] num_shell_tries                = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] num_volume_device_scan_tries   = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] nvmeof_conn_info_version       = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] nvmet_ns_id                    = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] nvmet_port_id                  = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] osapi_max_limit                = 1000 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] osapi_volume_ext_list          = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] osapi_volume_listen_port       = 8776 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] osapi_volume_use_ssl           = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] osapi_volume_workers           = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] per_volume_size_limit          = -1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] periodic_fuzzy_delay           = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] periodic_interval              = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] public_endpoint                = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] publish_errors                 = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] quota_backup_gigabytes         = 1000 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] quota_backups                  = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] quota_gigabytes                = 1000 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] quota_groups                   = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] quota_snapshots                = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] quota_volumes                  = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] rate_limit_burst               = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] rate_limit_except_level        = CRITICAL {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] rate_limit_interval            = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] reinit_driver_count            = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] replication_device             = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] report_discard_supported       = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] report_interval                = 120 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] reservation_clean_interval     = 86400 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] reservation_expire             = 86400 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] reserved_image_namespaces      = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] reserved_percentage            = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] rpc_response_timeout           = 120 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] run_external_periodic_tasks    = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] scst_target_driver             = iscsi {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] scst_target_iqn_name           = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_down_time              = 720 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] shell_completion               = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] snapshot_name_template         = snapshot-%s {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] split_loggers                  = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] state_path                     = /opt/stack/data/cinder {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] storage_availability_zone      = nova {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] storage_protocol               = iSCSI {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] syslog_log_facility            = LOG_USER {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] target_helper                  = lioadm {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] target_ip_address              = 192.168.122.37 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] target_port                    = 3260 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] target_protocol                = iscsi {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] target_secondary_ip_addresses  = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] trace_flags                    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] transport_url                  = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] until_refresh                  = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] use_chap_auth                  = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] use_default_quota_class        = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] use_journal                    = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] use_json                       = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] use_multipath_for_image_xfer   = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] use_stderr                     = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] use_syslog                     = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] verify_glance_signatures       = enabled {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_api_class               = cinder.volume.api.API {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_backend_name            = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_clear                   = zero {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_clear_ionice            = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_clear_size              = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_copy_bps_limit          = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_dd_blocksize            = 1M {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_name_template           = volume-%s {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_service_inithost_offload = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volume_usage_audit_period      = month {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] zoning_mode                    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_concurrency.disable_process_locking = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.auth_section = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.auth_type   = password {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.auth_version = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.cache       = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.certfile    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.include_service_catalog = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.insecure    = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.interface   = public {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.keyfile     = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_password =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcache_username =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.region_name = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.service_type = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.37/identity {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.backend                  = dogpile.cache.null {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.backend_argument         = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.backend_expiration_time  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.config_prefix            = cache.oslo {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.debug_cache_backend      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.enable_retry_client      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.enable_socket_keepalive  = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.enabled                  = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.expiration_time          = 600 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.hashclient_retry_attempts = 2 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.memcache_dead_retry      = 300 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.memcache_sasl_enabled    = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.password                 = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.proxies                  = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.redis_db                 = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.redis_server             = localhost:6379 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.retry_attempts           = 2 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.retry_delay              = 0.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.socket_keepalive_count   = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.socket_keepalive_idle    = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.socket_keepalive_interval = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.socket_timeout           = 1.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.tls_allowed_ciphers      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.tls_cafile               = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.tls_certfile             = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.tls_enabled              = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.tls_keyfile              = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cache.username                 = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] coordination.backend_url       = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.asyncio_connection    = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.asyncio_slave_connection = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.backend               = sqlalchemy {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.connection            = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.connection_debug      = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.connection_parameters =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.connection_recycle_time = 3600 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86754) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.connection_trace      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: WARNING cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.db_inc_retry_interval = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.db_max_retries        = 20 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: WARNING cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.db_max_retry_interval = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.db_retry_interval     = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.max_overflow          = 50 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.max_pool_size         = 5 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Running cmd (subprocess): mount.quobyte {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.max_retries           = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.mysql_wsrep_sync_wait = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.pool_timeout          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.retry_interval        = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.slave_connection      = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.sqlite_synchronous    = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.synchronous_reader    = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] database.use_db_reconnect      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.connection_string     = messaging:// {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.enabled               = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.es_doc_type           = notification {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.es_scroll_size        = 10000 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.es_scroll_time        = 2m {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.filter_error_trace    = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.hmac_keys             = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.sentinel_service_name = mymaster {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.socket_timeout        = 0.1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.trace_requests        = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler.trace_sqlalchemy      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler_jaeger.process_tags   = {} {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler_jaeger.service_name_prefix = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] profiler_otlp.service_name_prefix = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.enforce_new_defaults = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.policy_default_rule = default {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] privsep_osbrick.group          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] privsep_osbrick.helper_command = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] privsep_osbrick.user           = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_sys_admin.group         = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_sys_admin.helper_command = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] cinder_sys_admin.user          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.auth_section      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.auth_type         = password {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.cafile            = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.certfile          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.collect_timing    = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.insecure          = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.keyfile           = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.send_service_user_token = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.split_loggers     = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] service_user.timeout           = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.auth_section            = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.auth_type               = password {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.certfile                = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.collect_timing          = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.insecure                = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.keyfile                 = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.region_name             = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.split_loggers           = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] glance.timeout                 = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.backend_availability_zone = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.chap_password = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.chap_username =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.disk_geometry = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.driver_client_cert = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.driver_client_cert_key = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.driver_data_namespace = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.driver_use_ssl = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.extra_capabilities = {} {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.filter_function = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.goodness_function = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.iscsi_target_flags =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.iscsi_write_cache = on {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.iser_ip_address = 192.168.122.37 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.iser_port     = 3260 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_host      =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_login     = admin {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_mount_options = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_password  = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_private_key =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_share_path =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.num_shell_tries = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.quobyte_volume_url = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.replication_device = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.report_discard_supported = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.reserved_percentage = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.target_helper = tgtadm {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.target_ip_address = 192.168.122.37 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.target_port   = 3260 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.target_protocol = iscsi {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.trace_flags   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.unique_fqdn_network = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.use_chap_auth = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_backend_name = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_clear  = zero {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_clear_ionice = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_clear_size = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_reports.file_event_handler = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_reports.log_dir           = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.backend_availability_zone = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.backend_host         = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.chap_password        = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.chap_username        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.disk_geometry        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.driver_client_cert   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.driver_data_namespace = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack quobyte-client[86757]: Reading configuration file: /etc/quobyte/client.cfg
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.extra_capabilities   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.filter_function      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.goodness_function    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack quobyte-client[86757]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.iser_helper          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.iser_ip_address      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.iser_port            = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_host             = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_login            = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_mount_options    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_password         = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_private_key      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_share_path       = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.num_shell_tries      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.replication_device   = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.report_discard_supported = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.reserved_percentage  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.scst_target_driver   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.storage_protocol     = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.target_helper        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.target_ip_address    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.target_port          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.target_prefix        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.target_protocol      = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.trace_flags          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.use_chap_auth        = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_clear         = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_clear_size    = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] QuobyteHD.volumes_dir          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=86754) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: INFO cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 ...
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad -c /etc/quobyte/client-cinder.cfg {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_notifications.driver = [] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_notifications.retry = -1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] key_manager.fixed_key          = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.barbican_api_version  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.barbican_endpoint     = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.barbican_endpoint_type = public {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.barbican_region_name  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.cafile                = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.certfile              = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.collect_timing        = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.insecure              = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.keyfile               = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.number_of_retries     = 60 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.retry_delay           = 1 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.send_service_user_token = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.split_loggers         = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.timeout               = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.verify_ssl            = True {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican.verify_ssl_path       = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.auth_section = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.auth_type = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.cafile   = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.certfile = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.collect_timing = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.insecure = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.keyfile  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.split_loggers = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] barbican_service_user.timeout  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.approle_role_id          = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.approle_secret_id        = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.auth_method              = approle {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.auth_path                = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.kv_mountpoint            = secret {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.kv_path                  = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.kv_version               = 2 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.namespace                = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.root_token_id            = **** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.ssl_ca_crt_file          = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.timeout                  = 60.0 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.token_file               = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.token_role               = None {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.use_ssl                  = False {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:04 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] ******************************************************************************** {{(pid=86532) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 17 03:38:04 devstack sudo[86758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad -c /etc/quobyte/client-cinder.cfg
Jul 17 03:38:04 devstack sudo[86758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:04 devstack sudo[86758]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.428s {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:04 devstack cinder-volume[86754]: INFO cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 succeeded
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=86754) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.450s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:38:04 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:04 devstack sudo[86834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:38:04 devstack sudo[86834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:05 devstack sudo[86834]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.281s {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:05 devstack cinder-volume[86754]: INFO cinder.volume.driver [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Driver hasn't implemented _init_vendor_properties()
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.volume.driver [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6883850097656, 'free_capacity_gb': 1775.6883850097656, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86754) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_db.sqlalchemy.engines [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86754) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG dbcounter [-] [86754] Writer thread running {{(pid=86754) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.db.api [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Building query based on filter {{(pid=86754) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.image.image_utils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86754) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 17 03:38:05 devstack cinder-volume[86754]: INFO cinder.keymgr.migration [None req-6c36a20b-7645-4960-930f-0ebe9583a208 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=86754) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=86754) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:05 devstack sudo[86847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:38:05 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:05 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.245s {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.manager [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Notifying Schedulers of capabilities ... {{(pid=86754) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:38:05 devstack cinder-volume[86754]: INFO cinder.volume.manager [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Driver initialization completed successfully.
Jul 17 03:38:05 devstack cinder-volume[86754]: INFO cinder.manager [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Initiating service 3 cleanup
Jul 17 03:38:05 devstack cinder-volume[86754]: INFO cinder.manager [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Service 3 cleanup completed.
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.service [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Creating RPC server for service cinder-volume {{(pid=86754) start /opt/stack/cinder/cinder/service.py:231}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.service [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86754) start /opt/stack/cinder/cinder/service.py:237}}
Jul 17 03:38:05 devstack cinder-volume[86754]: INFO cinder.volume.manager [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=86754) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=86754) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:05 devstack sudo[86858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:38:05 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:05 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:05 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.275s {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:05 devstack cinder-volume[86754]: INFO cinder.volume.manager [None req-1574406c-2237-49b3-bad8-837b1d9f789e None None] Driver post RPC initialization completed successfully.
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=86754) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG cinder.volume.drivers.quobyte [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=86754) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:11 devstack sudo[87090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:38:11 devstack sudo[87090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:11 devstack sudo[87090]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG oslo_concurrency.processutils [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.272s {{(pid=86754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:11 devstack cinder-volume[86754]: DEBUG cinder.manager [None req-ec785301-7c6f-4c2f-803b-58143b67c82b None None] Notifying Schedulers of capabilities ... {{(pid=86754) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:38:11 devstack cinder-volume[86532]: INFO oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Caught SIGTERM, stopping children
Jul 17 03:38:11 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Acquiring lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 17 03:38:11 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Acquired lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 17 03:38:11 devstack cinder-volume[86532]: DEBUG oslo_concurrency.lockutils [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Releasing lock "singleton_lock" {{(pid=86532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 17 03:38:11 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Stop services. {{(pid=86532) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 17 03:38:11 devstack cinder-volume[86532]: DEBUG oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Killing children. {{(pid=86532) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 17 03:38:11 devstack cinder-volume[86532]: INFO oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Waiting on 1 children to exit
Jul 17 03:38:13 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Acquiring lock "singleton_lock" {{(pid=86754) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 17 03:38:13 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Acquired lock "singleton_lock" {{(pid=86754) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 17 03:38:13 devstack cinder-volume[86754]: DEBUG oslo_concurrency.lockutils [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Releasing lock "singleton_lock" {{(pid=86754) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 17 03:38:13 devstack cinder-volume[86754]: WARNING amqp [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 17 03:38:13 devstack cinder-volume[86754]: WARNING amqp [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 17 03:38:13 devstack cinder-volume[86532]: INFO oslo_service.backend._eventlet.service [None req-5e512a77-b9b9-4edb-9d0d-875edc33abc8 None None] Child 86754 exited with status 0
Jul 17 03:38:14 devstack cinder-volume[87189]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 17 03:38:14 devstack cinder-volume[87189]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 17 03:38:14 devstack cinder-volume[87189]: we strongly recommend against using it for new projects.
Jul 17 03:38:14 devstack cinder-volume[87189]: If you are already using Eventlet, we recommend migrating to a different
Jul 17 03:38:14 devstack cinder-volume[87189]: framework.  For more detail see
Jul 17 03:38:14 devstack cinder-volume[87189]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 17 03:38:14 devstack cinder-volume[87189]:   import eventlet  # noqa
Jul 17 03:38:17 devstack cinder-volume[87189]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Jul 17 03:38:17 devstack cinder-volume[87189]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Jul 17 03:38:17 devstack cinder-volume[87189]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Jul 17 03:38:18 devstack cinder-volume[87189]: INFO dbcounter [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Registered counter for database cinder
Jul 17 03:38:18 devstack cinder-volume[87189]: DEBUG oslo_db.sqlalchemy.engines [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG dbcounter [-] [87189] Writer thread running {{(pid=87189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 17 03:38:19 devstack cinder-volume[87189]: INFO cinder.rpc [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 17 03:38:19 devstack cinder-volume[87189]: INFO cinder.rpc [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_db.sqlalchemy.engines [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:19 devstack cinder-volume[87189]: INFO cinder.volume.manager [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Determined volume DB was empty at startup.
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG cinder.volume.manager [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87189) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 17 03:38:19 devstack cinder-volume[87189]: WARNING stevedore.named [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 17 03:38:19 devstack cinder-volume[87189]: WARNING castellan.key_manager [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 17 03:38:19 devstack cinder-volume[87189]: WARNING cinder.keymgr.conf_key_mgr [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 17 03:38:19 devstack cinder-volume[87189]: INFO cinder.volume.manager [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_db.sqlalchemy.engines [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:19 devstack cinder-volume[87189]: INFO oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Starting 1 workers
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Started child 87498 {{(pid=87189) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Full set of CONF: {{(pid=87189) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] ******************************************************************************** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] Configuration options gathered from: {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] ================================================================================ {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] allow_availability_zone_fallback = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] allow_compression_on_image_upload = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] allowed_direct_url_schemes     = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] api_rate_limit                 = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] auth_strategy                  = keystone {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_availability_zone      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_host                   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_name                   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_stats_polling_interval = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backup_api_class               = cinder.backup.api.API {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backup_name_template           = backup-%s {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backup_use_same_host           = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backup_use_temp_snapshot       = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] chap_password                  = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87498]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] chap_username                  =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_internal_tenant_project_id = 9ddd5c6aadcb4becbf7cc8868485851c {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_internal_tenant_user_id = 1d3f51d21f914cb3a3afdb76840051b9 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cluster                        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] compression_format             = gzip {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] compute_api_class              = cinder.compute.nova.API {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] config_dir                     = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] config_source                  = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] control_exchange               = openstack {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] debug                          = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] default_availability_zone      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] default_group_type             = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] default_volume_type            = QuobyteHD {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] disk_geometry                  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] driver_client_cert             = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] driver_client_cert_key         = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] driver_data_namespace          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] driver_ssl_cert_path           = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] driver_ssl_cert_verify         = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] driver_use_ssl                 = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] enable_new_services            = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] enable_unsupported_driver      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] enabled_backends               = ['QuobyteHD'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] enforce_multipath_for_image_xfer = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] filter_function                = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_api_insecure            = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_api_servers             = ['http://192.168.122.37/image'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_api_ssl_compression     = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_ca_certificates_file    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_catalog_info            = image:glance:publicURL {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_certfile                = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_keyfile                 = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_num_retries             = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance_request_timeout         = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] goodness_function              = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] graceful_shutdown_timeout      = 5 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] group_api_class                = cinder.group.api.API {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] host                           = devstack {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_compress_on_upload       = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_conversion_address_space_limit = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_conversion_cpu_limit     = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_conversion_disable       = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_upload_use_cinder_backend = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_upload_use_internal_tenant = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_volume_cache_enabled     = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_volume_cache_max_count   = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] image_volume_cache_max_size_gb = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] init_host_max_objects_retrieval = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] instance_format                = [instance: %(uuid)s]  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] iscsi_target_flags             =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] iscsi_write_cache              = on {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] iser_helper                    = tgtadm {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] iser_ip_address                = 192.168.122.37 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] iser_port                      = 3260 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_color                      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_config_append              = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_dir                        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_file                       = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_options                    = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_rotate_interval            = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_rotate_interval_type       = days {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] log_rotation_type              = none {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] max_age                        = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] max_logfile_count              = 30 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] max_logfile_size_mb            = 200 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] max_over_subscription_ratio    = 20.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] message_reap_interval          = 86400 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] message_ttl                    = 2592000 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] migration_create_volume_timeout_secs = 300 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] monkey_patch                   = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] monkey_patch_modules           = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] my_ip                          = 192.168.122.37 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] no_snapshot_gb_quota           = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] num_iser_scan_tries            = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] num_shell_tries                = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] num_volume_device_scan_tries   = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] nvmeof_conn_info_version       = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] nvmet_ns_id                    = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] nvmet_port_id                  = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] osapi_max_limit                = 1000 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] osapi_volume_ext_list          = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] osapi_volume_listen_port       = 8776 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] osapi_volume_use_ssl           = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] osapi_volume_workers           = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] per_volume_size_limit          = -1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] periodic_fuzzy_delay           = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] periodic_interval              = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] public_endpoint                = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] publish_errors                 = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] quota_backup_gigabytes         = 1000 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] quota_backups                  = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] quota_gigabytes                = 1000 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] quota_groups                   = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] quota_snapshots                = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] quota_volumes                  = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] rate_limit_burst               = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] rate_limit_except_level        = CRITICAL {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] rate_limit_interval            = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] reinit_driver_count            = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] replication_device             = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] report_discard_supported       = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] report_interval                = 120 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] reservation_clean_interval     = 86400 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] reservation_expire             = 86400 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] reserved_image_namespaces      = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] reserved_percentage            = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] rpc_response_timeout           = 120 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] run_external_periodic_tasks    = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] scst_target_driver             = iscsi {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] scst_target_iqn_name           = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_down_time              = 720 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] shell_completion               = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] snapshot_name_template         = snapshot-%s {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] split_loggers                  = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] state_path                     = /opt/stack/data/cinder {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] storage_availability_zone      = nova {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] storage_protocol               = iSCSI {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] syslog_log_facility            = LOG_USER {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] target_helper                  = lioadm {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] target_ip_address              = 192.168.122.37 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] target_port                    = 3260 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] target_protocol                = iscsi {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] target_secondary_ip_addresses  = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] trace_flags                    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] transport_url                  = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] until_refresh                  = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] use_chap_auth                  = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] use_default_quota_class        = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] use_journal                    = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] use_json                       = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] use_multipath_for_image_xfer   = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] use_stderr                     = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] use_syslog                     = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] verify_glance_signatures       = enabled {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_api_class               = cinder.volume.api.API {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_backend_name            = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_clear                   = zero {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_clear_ionice            = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_clear_size              = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_copy_bps_limit          = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_dd_blocksize            = 1M {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_name_template           = volume-%s {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_service_inithost_offload = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volume_usage_audit_period      = month {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] zoning_mode                    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_concurrency.disable_process_locking = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.auth_section = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.auth_type   = password {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.auth_version = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.cache       = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.certfile    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.include_service_catalog = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.insecure    = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.interface   = public {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.keyfile     = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_password =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcache_username =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.region_name = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.service_type = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.37/identity {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.backend                  = dogpile.cache.null {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.backend_argument         = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.backend_expiration_time  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.config_prefix            = cache.oslo {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.debug_cache_backend      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.enable_retry_client      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.enable_socket_keepalive  = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.enabled                  = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.expiration_time          = 600 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.hashclient_retry_attempts = 2 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.memcache_dead_retry      = 300 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.memcache_pool_maxsize    = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.memcache_sasl_enabled    = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.password                 = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.proxies                  = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.redis_db                 = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.redis_server             = localhost:6379 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.retry_attempts           = 2 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.retry_delay              = 0.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.socket_keepalive_count   = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.socket_keepalive_idle    = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.socket_keepalive_interval = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.socket_timeout           = 1.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.tls_allowed_ciphers      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.tls_cafile               = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.tls_certfile             = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.tls_enabled              = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.tls_keyfile              = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cache.username                 = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] coordination.backend_url       = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.asyncio_connection    = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.asyncio_slave_connection = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.backend               = sqlalchemy {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.connection            = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack quobyte-client[87499]: Reading configuration file: /etc/quobyte/client.cfg
Jul 17 03:38:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Starting volume driver QuobyteDriver (1.2)
Jul 17 03:38:19 devstack quobyte-client[87499]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.connection_debug      = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87498) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.connection_parameters =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.connection_recycle_time = 3600 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.connection_trace      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.db_inc_retry_interval = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.db_max_retries        = 20 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.db_max_retry_interval = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.db_retry_interval     = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.max_overflow          = 50 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.max_pool_size         = 5 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.max_retries           = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.mysql_wsrep_sync_wait = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.pool_timeout          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.retry_interval        = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.slave_connection      = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.sqlite_synchronous    = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.synchronous_reader    = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] database.use_db_reconnect      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.connection_string     = messaging:// {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.enabled               = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.es_doc_type           = notification {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.es_scroll_size        = 10000 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.es_scroll_time        = 2m {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.filter_error_trace    = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.hmac_keys             = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.sentinel_service_name = mymaster {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.socket_timeout        = 0.1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.trace_requests        = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler.trace_sqlalchemy      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler_jaeger.process_tags   = {} {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler_jaeger.service_name_prefix = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] profiler_otlp.service_name_prefix = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.enforce_new_defaults = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.policy_default_rule = default {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.policy_file        = policy.yaml {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] privsep_osbrick.group          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] privsep_osbrick.helper_command = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] privsep_osbrick.user           = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_sys_admin.group         = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_sys_admin.helper_command = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] cinder_sys_admin.user          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.auth_section      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.auth_type         = password {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.cafile            = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.certfile          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.collect_timing    = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.insecure          = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.keyfile           = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.send_service_user_token = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.split_loggers     = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] service_user.timeout           = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.auth_section            = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.auth_type               = password {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.certfile                = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.collect_timing          = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.insecure                = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.keyfile                 = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.region_name             = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.split_loggers           = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] glance.timeout                 = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.backend_availability_zone = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.chap_password = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.chap_username =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.disk_geometry = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.driver_client_cert = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.driver_client_cert_key = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.driver_data_namespace = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.driver_use_ssl = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.extra_capabilities = {} {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.filter_function = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.goodness_function = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.iscsi_target_flags =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.iscsi_write_cache = on {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.iser_helper   = tgtadm {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.iser_ip_address = 192.168.122.37 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.iser_port     = 3260 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_host      =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_login     = admin {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_mount_options = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_password  = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_private_key =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_share_path =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.num_shell_tries = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.quobyte_volume_url = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.replication_device = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.report_discard_supported = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.reserved_percentage = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87498) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Jul 17 03:38:19 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 17 03:38:19 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.target_helper = tgtadm {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Running cmd (subprocess): mount.quobyte {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.target_ip_address = 192.168.122.37 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.target_port   = 3260 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.target_protocol = iscsi {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.trace_flags   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.unique_fqdn_network = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.use_chap_auth = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_backend_name = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_clear  = zero {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_clear_ionice = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_clear_size = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_reports.file_event_handler = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_reports.log_dir           = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.backend_availability_zone = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.backend_host         = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.chap_password        = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.chap_username        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.chiscsi_conf         = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.disk_geometry        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.driver_client_cert   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.driver_data_namespace = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.driver_use_ssl       = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.extra_capabilities   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.filter_function      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.goodness_function    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.iser_helper          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.iser_ip_address      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.iser_port            = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.iser_target_prefix   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_host             = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:19 devstack sudo[87502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_login            = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_mount_options    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_password         = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_private_key      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_share_path       = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_ssh_port         = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.num_shell_tries      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.nvmet_port_id        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.replication_device   = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.report_discard_supported = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.reserved_percentage  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.scst_target_driver   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.storage_protocol     = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.target_helper        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.target_ip_address    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.target_port          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.target_prefix        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.target_protocol      = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.trace_flags          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.use_chap_auth        = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_clear         = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_clear_size    = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] QuobyteHD.volumes_dir          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.ssl      = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_notifications.driver = [] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_notifications.retry = -1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] key_manager.fixed_key          = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.barbican_api_version  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.barbican_endpoint     = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.barbican_endpoint_type = public {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.barbican_region_name  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.cafile                = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.certfile              = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.collect_timing        = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.insecure              = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.keyfile               = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.number_of_retries     = 60 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.retry_delay           = 1 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.send_service_user_token = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.split_loggers         = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.timeout               = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.verify_ssl            = True {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican.verify_ssl_path       = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.auth_section = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.auth_type = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.cafile   = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.certfile = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.collect_timing = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.insecure = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.keyfile  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.split_loggers = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] barbican_service_user.timeout  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.approle_role_id          = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.approle_secret_id        = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.auth_method              = approle {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.auth_path                = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.kv_mountpoint            = secret {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.kv_path                  = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.kv_version               = 2 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.namespace                = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.root_token_id            = **** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.ssl_ca_crt_file          = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.timeout                  = 60.0 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.token_file               = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.token_role               = None {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.use_ssl                  = False {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 17 03:38:20 devstack cinder-volume[87189]: DEBUG oslo_service.backend._eventlet.service [None req-1663aa5a-cde0-4846-9f40-8190c102a04e None None] ******************************************************************************** {{(pid=87189) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 17 03:38:20 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:20 devstack cinder-volume[87498]: INFO cinder.volume.driver [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Driver hasn't implemented _init_vendor_properties()
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.volume.driver [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6883850097656, 'free_capacity_gb': 1775.6883850097656, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_db.sqlalchemy.engines [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writer thread running {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.db.api [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Building query based on filter {{(pid=87498) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87498) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:20 devstack cinder-volume[87498]: INFO cinder.keymgr.migration [None req-d95f7c1e-2295-4dde-8e9b-b72393605016 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 17 03:38:20 devstack sudo[87513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:38:20 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:20 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:38:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Driver initialization completed successfully.
Jul 17 03:38:20 devstack cinder-volume[87498]: INFO cinder.manager [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Initiating service 3 cleanup
Jul 17 03:38:20 devstack cinder-volume[87498]: INFO cinder.manager [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Service 3 cleanup completed.
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.service [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Creating RPC server for service cinder-volume {{(pid=87498) start /opt/stack/cinder/cinder/service.py:231}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.service [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87498) start /opt/stack/cinder/cinder/service.py:237}}
Jul 17 03:38:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:38:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:38:20 devstack sudo[87516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:38:20 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:38:21 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root
Jul 17 03:38:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.225s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:38:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f861df97-1105-4bbb-a5bc-578e91bc6a7b None None] Driver post RPC initialization completed successfully.
Jul 17 03:38:29 devstack cinder-volume[87189]: DEBUG dbcounter [-] [87189] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:38:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:38:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:39:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:39:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 6 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:39:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Flow 'volume_create_manager' (a0fc5a23-c4dd-4c9a-b19b-64b842f39fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcca28e4-9ddd-4132-a78a-d6090dbd1449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcca28e4-9ddd-4132-a78a-d6090dbd1449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1414905594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cda7dc-e394-421a-bee5-f6561c00eba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9b4528b17c4722bdfa83ad5aa51a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:39:19Z,use_quota=True,user_id='1774f58b86c346768fa686948421fdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b3cd76-210d-42ee-97e1-caf9dd0c42df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b3cd76-210d-42ee-97e1-caf9dd0c42df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c26630-a60c-41ac-8c1b-aae97036be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8c26630-a60c-41ac-8c1b-aae97036be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5cda7dc-e394-421a-bee5-f6561c00eba0', 'volume_name': 'volume-c5cda7dc-e394-421a-bee5-f6561c00eba0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c15867-a462-4d9a-b5a4-29b14a73b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c15867-a462-4d9a-b5a4-29b14a73b963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7602885a-dec3-4e99-a6e5-883c5532ba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Volume c5cda7dc-e394-421a-bee5-f6561c00eba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5cda7dc-e394-421a-bee5-f6561c00eba0', 'volume_size': 1}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1414905594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5cda7dc-e394-421a-bee5-f6561c00eba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca9b4528b17c4722bdfa83ad5aa51a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:39:19Z,use_quota=True,user_id='1774f58b86c346768fa686948421fdef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Creating volume c5cda7dc-e394-421a-bee5-f6561c00eba0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:39:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:39:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:19 devstack sudo[87737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0 1073741824
Jul 17 03:39:19 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:20 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0 1073741824" returned: 0 in 0.810s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:20 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0
Jul 17 03:39:20 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:20 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7602885a-dec3-4e99-a6e5-883c5532ba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5cda7dc-e394-421a-bee5-f6561c00eba0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7c77c1-8fad-480e-a939-3590188f2d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Volume volume-c5cda7dc-e394-421a-bee5-f6561c00eba0 (c5cda7dc-e394-421a-bee5-f6561c00eba0): created successfully
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7c77c1-8fad-480e-a939-3590188f2d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Flow 'volume_create_manager' (a0fc5a23-c4dd-4c9a-b19b-64b842f39fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:39:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a3548ed9-9534-44f6-b044-68b424328ff8 tempest-TaggedAttachmentsTest-1681234893 None] Created volume successfully.
Jul 17 03:39:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:39:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Flow 'volume_create_manager' (f90f69bd-8ce1-47da-a149-0cd106aba263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0100785-ff4c-4df2-8e47-1e3bc5ee32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0100785-ff4c-4df2-8e47-1e3bc5ee32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-218542173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482b765f-1e03-4a71-ae29-957a206ef570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055dff936ea44db58c9d153d63510559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:39:34Z,use_quota=True,user_id='acd925832ba94a528737452241bfaf44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce71ac58-937c-4f6e-b24f-61358c450e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce71ac58-937c-4f6e-b24f-61358c450e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ddece1-e7b0-4724-ae7f-d3ce200ec40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ddece1-e7b0-4724-ae7f-d3ce200ec40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482b765f-1e03-4a71-ae29-957a206ef570', 'volume_name': 'volume-482b765f-1e03-4a71-ae29-957a206ef570', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dafdaa9-482f-410a-ae08-37b089ef3301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dafdaa9-482f-410a-ae08-37b089ef3301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14902cd7-7c16-431c-a527-047c0f0a8581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Volume 482b765f-1e03-4a71-ae29-957a206ef570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482b765f-1e03-4a71-ae29-957a206ef570', 'volume_size': 1}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-218542173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482b765f-1e03-4a71-ae29-957a206ef570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='055dff936ea44db58c9d153d63510559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:39:34Z,use_quota=True,user_id='acd925832ba94a528737452241bfaf44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Creating volume 482b765f-1e03-4a71-ae29-957a206ef570 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:39:34 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:39:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:34 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570 1073741824
Jul 17 03:39:34 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:36 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570 1073741824" returned: 0 in 1.502s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:36 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570
Jul 17 03:39:36 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:37 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570" returned: 0 in 0.827s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:39:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.456s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14902cd7-7c16-431c-a527-047c0f0a8581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482b765f-1e03-4a71-ae29-957a206ef570', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26418d35-f767-4787-8bee-ee9764b0ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Volume volume-482b765f-1e03-4a71-ae29-957a206ef570 (482b765f-1e03-4a71-ae29-957a206ef570): created successfully
Jul 17 03:39:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26418d35-f767-4787-8bee-ee9764b0ab51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Flow 'volume_create_manager' (f90f69bd-8ce1-47da-a149-0cd106aba263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:39:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b2f50b5f-5e4d-41fa-9e47-cf17278a804e tempest-DeleteServersTestJSON-1462638403 None] Created volume successfully.
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Flow 'volume_create_manager' (f9deac27-3cbc-42dc-9ca9-fc9bd6c17909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618457df-c263-408b-8e34-1a55df198c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (618457df-c263-408b-8e34-1a55df198c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-593940000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a2052d-5005-4807-9e3f-447a8508428a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63692632cfe84c77b34e5193752c129a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:39:38Z,use_quota=True,user_id='4bf3e4ee852342118ce163bd88ef0ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a4479a-bc90-4961-a9c0-45d590daa43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a4479a-bc90-4961-a9c0-45d590daa43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9f87ce-b738-4e19-9c12-9487921b857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9f87ce-b738-4e19-9c12-9487921b857b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a2052d-5005-4807-9e3f-447a8508428a', 'volume_name': 'volume-19a2052d-5005-4807-9e3f-447a8508428a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89477783-e45d-4a64-a6b7-d3906e552ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89477783-e45d-4a64-a6b7-d3906e552ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4778390-6d6c-4271-9775-ace4f8f33f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Volume 19a2052d-5005-4807-9e3f-447a8508428a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a2052d-5005-4807-9e3f-447a8508428a', 'volume_size': 1}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-593940000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a2052d-5005-4807-9e3f-447a8508428a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63692632cfe84c77b34e5193752c129a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:39:38Z,use_quota=True,user_id='4bf3e4ee852342118ce163bd88ef0ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Creating volume 19a2052d-5005-4807-9e3f-447a8508428a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:39:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:39:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:38 devstack sudo[88377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a 1073741824
Jul 17 03:39:38 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:39 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a 1073741824" returned: 0 in 1.141s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:39 devstack sudo[88391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a
Jul 17 03:39:39 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:40 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a" returned: 0 in 0.591s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:39:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4778390-6d6c-4271-9775-ace4f8f33f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a2052d-5005-4807-9e3f-447a8508428a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d93353-8dcc-4d8b-908f-c4665b0d5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:39:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Volume volume-19a2052d-5005-4807-9e3f-447a8508428a (19a2052d-5005-4807-9e3f-447a8508428a): created successfully
Jul 17 03:39:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d93353-8dcc-4d8b-908f-c4665b0d5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:39:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Flow 'volume_create_manager' (f9deac27-3cbc-42dc-9ca9-fc9bd6c17909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:39:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8a9c7d26-348e-410a-b46c-ae35c0967f6a tempest-VolumesAdminNegativeTest-1592060668 None] Created volume successfully.
Jul 17 03:39:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Acquiring lock "cinder-19a2052d-5005-4807-9e3f-447a8508428a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:39:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Lock "cinder-19a2052d-5005-4807-9e3f-447a8508428a-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:39:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Acquiring lock "cinder-quobyte-19a2052d-5005-4807-9e3f-447a8508428a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:39:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Lock "cinder-quobyte-19a2052d-5005-4807-9e3f-447a8508428a" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:39:42 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqxtvisdo/privsep.sock']
Jul 17 03:39:42 devstack sudo[88418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqxtvisdo/privsep.sock
Jul 17 03:39:42 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING py.warnings [req-976d771d-8f21-4262-aff6-07d7d7d56cbc req-6e6203fa-fc35-4bdf-a129-23e5ce7b9dd4 tempest-DeleteServersTestJSON-1462638403 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jul 17 03:39:44 devstack cinder-volume[87498]:   .first()
Jul 17 03:39:44 devstack cinder-volume[87498]: 
Jul 17 03:39:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-976d771d-8f21-4262-aff6-07d7d7d56cbc req-6e6203fa-fc35-4bdf-a129-23e5ce7b9dd4 tempest-DeleteServersTestJSON-1462638403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-976d771d-8f21-4262-aff6-07d7d7d56cbc req-6e6203fa-fc35-4bdf-a129-23e5ce7b9dd4 tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-976d771d-8f21-4262-aff6-07d7d7d56cbc req-6e6203fa-fc35-4bdf-a129-23e5ce7b9dd4 tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-976d771d-8f21-4262-aff6-07d7d7d56cbc req-6e6203fa-fc35-4bdf-a129-23e5ce7b9dd4 tempest-DeleteServersTestJSON-1462638403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-482b765f-1e03-4a71-ae29-957a206ef570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50825932-dc0b-45a0-9b90-d0da2119ffd8', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 17 03:39:44 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Jul 17 03:39:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-976d771d-8f21-4262-aff6-07d7d7d56cbc req-6e6203fa-fc35-4bdf-a129-23e5ce7b9dd4 tempest-DeleteServersTestJSON-1462638403 None] attachment_update completed successfully.
Jul 17 03:39:45 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:45 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Spawned new privsep daemon via rootwrap
Jul 17 03:39:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Accepted privsep connection to /tmp/tmpqxtvisdo/privsep.sock {{(pid=87498) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 17 03:39:45 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 17 03:39:45 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 17 03:39:45 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 17 03:39:45 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88435
Jul 17 03:39:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a4f681-5090-4767-86e2-37b3383e19ad]: (2,) {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:39:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fd27d0-146d-4599-813f-3365bccd26a6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:39:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:46 devstack sudo[88439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a
Jul 17 03:39:46 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:46 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a" returned: 0 in 1.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:46 devstack sudo[88862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a
Jul 17 03:39:46 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:47 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-19a2052d-5005-4807-9e3f-447a8508428a" returned: 0 in 0.795s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Lock "cinder-quobyte-19a2052d-5005-4807-9e3f-447a8508428a" released by "delete_volume" :: held 5.363s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:39:47 devstack cinder-volume[87498]: WARNING cinder.quota [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:39:47 devstack cinder-volume[87498]: WARNING cinder.quota [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:39:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Created reservations ['0bdb019d-920c-4129-8ccc-f4a8cf77a50a', 'e6e364af-ad3b-4436-8102-7a51d7a92478', '4202b0b7-e176-4253-a60c-7573be712319', 'f0dc3410-0e23-4d49-8275-b379c34d1543'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:39:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:39:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:39:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:48 devstack sudo[88904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:39:48 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:48 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.749s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:49 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:39:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Deleted volume successfully.
Jul 17 03:39:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fff9e68a-ab8e-4170-a145-be98b1a54209 tempest-VolumesAdminNegativeTest-1592060668 None] Lock "cinder-19a2052d-5005-4807-9e3f-447a8508428a-delete_volume" released by "delete_volume" :: held 7.017s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:39:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-8de8aaae-4e20-45e3-8952-163aed8ad8e6 req-0f229488-9002-4c11-96e2-5e0cc732e4b0 tempest-DeleteServersTestJSON-1462638403 None] Terminate volume connection completed successfully.
Jul 17 03:39:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-8de8aaae-4e20-45e3-8952-163aed8ad8e6 req-0f229488-9002-4c11-96e2-5e0cc732e4b0 tempest-DeleteServersTestJSON-1462638403 None] Deleting attachment 50825932-dc0b-45a0-9b90-d0da2119ffd8. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:39:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Acquiring lock "cinder-482b765f-1e03-4a71-ae29-957a206ef570-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:39:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Lock "cinder-482b765f-1e03-4a71-ae29-957a206ef570-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:39:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Acquiring lock "cinder-quobyte-482b765f-1e03-4a71-ae29-957a206ef570" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:39:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Lock "cinder-quobyte-482b765f-1e03-4a71-ae29-957a206ef570" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:39:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e9fab8-cc50-4da5-8941-111b0e5a2445]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:39:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:54 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570
Jul 17 03:39:54 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:55 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:55 devstack sudo[89023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570
Jul 17 03:39:55 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:55 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-482b765f-1e03-4a71-ae29-957a206ef570" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Lock "cinder-quobyte-482b765f-1e03-4a71-ae29-957a206ef570" released by "delete_volume" :: held 0.742s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Created reservations ['3d4b7b2a-d07b-46c4-a536-f94e74c7a09d', 'd5dbcc95-8d91-47d1-861d-e86ffc352d39', 'a4fd3de6-7004-45e9-9fd8-c767bf39099d', 'f94955ed-6184-404c-8ade-8fd6bdd35fa8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:39:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:39:55 devstack sudo[89026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:39:55 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:39:56 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root
Jul 17 03:39:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:39:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:39:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Deleted volume successfully.
Jul 17 03:39:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bd8061b-214f-4c72-b802-a23879e4efdd tempest-DeleteServersTestJSON-1462638403 None] Lock "cinder-482b765f-1e03-4a71-ae29-957a206ef570-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:40:05 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=20,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:40:06 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=21,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:40:12 devstack sudo[89063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:40:12 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:40:12 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:40:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:40:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-007c024c-b5e4-4b86-9d0a-9cd5b83f086c req-c063d518-8da6-4cdc-90bf-09bf13928292 tempest-TaggedAttachmentsTest-1681234893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:40:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-007c024c-b5e4-4b86-9d0a-9cd5b83f086c req-c063d518-8da6-4cdc-90bf-09bf13928292 tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:40:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-007c024c-b5e4-4b86-9d0a-9cd5b83f086c req-c063d518-8da6-4cdc-90bf-09bf13928292 tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:40:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-007c024c-b5e4-4b86-9d0a-9cd5b83f086c req-c063d518-8da6-4cdc-90bf-09bf13928292 tempest-TaggedAttachmentsTest-1681234893 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-c5cda7dc-e394-421a-bee5-f6561c00eba0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6dfdb601-07be-4b8f-968a-a88584123e84', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:40:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-007c024c-b5e4-4b86-9d0a-9cd5b83f086c req-c063d518-8da6-4cdc-90bf-09bf13928292 tempest-TaggedAttachmentsTest-1681234893 None] attachment_update completed successfully.
Jul 17 03:40:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-2f2785aa-0530-491f-b17f-9049edd049fa req-9b0eca9e-de3b-4a36-9d96-785d1bd8fa30 tempest-TaggedAttachmentsTest-1681234893 None] Terminate volume connection completed successfully.
Jul 17 03:40:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-2f2785aa-0530-491f-b17f-9049edd049fa req-9b0eca9e-de3b-4a36-9d96-785d1bd8fa30 tempest-TaggedAttachmentsTest-1681234893 None] Deleting attachment 6dfdb601-07be-4b8f-968a-a88584123e84. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:40:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:40:42 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:40:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Acquiring lock "cinder-c5cda7dc-e394-421a-bee5-f6561c00eba0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:40:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Lock "cinder-c5cda7dc-e394-421a-bee5-f6561c00eba0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:40:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Acquiring lock "cinder-quobyte-c5cda7dc-e394-421a-bee5-f6561c00eba0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:40:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Lock "cinder-quobyte-c5cda7dc-e394-421a-bee5-f6561c00eba0" acquired by "delete_volume" :: waited 0.061s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:40:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[83269392-f628-4141-9d88-48f9b7dbdddc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:40:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:40:56 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0
Jul 17 03:40:56 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:40:56 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Jul 17 03:40:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0" returned: 0 in 0.600s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:40:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:40:56 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0
Jul 17 03:40:56 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:40:56 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Jul 17 03:40:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c5cda7dc-e394-421a-bee5-f6561c00eba0" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Lock "cinder-quobyte-c5cda7dc-e394-421a-bee5-f6561c00eba0" released by "delete_volume" :: held 1.192s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Created reservations ['c8f0d2d8-caa7-4fd2-b34c-6a51a2c471c0', '2ce3d471-cf2e-41f9-b72b-ce3dbaa6309d', '33591ab8-9b3e-4eba-afea-fe863db32536', '4e58393e-f732-42be-b6fb-7e6b45a3406d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:40:57 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:40:57 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:40:57 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:40:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Deleted volume successfully.
Jul 17 03:40:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b08f4fad-9a30-43b8-8cdf-32f3452118cb tempest-TaggedAttachmentsTest-1681234893 None] Lock "cinder-c5cda7dc-e394-421a-bee5-f6561c00eba0-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Flow 'volume_create_manager' (1f78c01b-65f4-44e5-9914-3c155ad6990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2ba2d4-5504-405a-b5e0-10d813533772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2ba2d4-5504-405a-b5e0-10d813533772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1746203583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e211750-1e54-47af-817c-1031c3e3d880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e042c70768473fa4e01141f754e1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:02Z,use_quota=True,user_id='82841529b9c949628b6fd2115cd5f872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5326c007-6a25-44ec-a8af-0002c5f7281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5326c007-6a25-44ec-a8af-0002c5f7281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1960f5-4004-4233-8b90-48858abf4f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1960f5-4004-4233-8b90-48858abf4f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e211750-1e54-47af-817c-1031c3e3d880', 'volume_name': 'volume-2e211750-1e54-47af-817c-1031c3e3d880', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff059015-f5d0-4bef-8c5e-7afad014e255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff059015-f5d0-4bef-8c5e-7afad014e255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3a97e2-b819-4475-a677-76a7baf0fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Volume 2e211750-1e54-47af-817c-1031c3e3d880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e211750-1e54-47af-817c-1031c3e3d880', 'volume_size': 1}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1746203583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e211750-1e54-47af-817c-1031c3e3d880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e042c70768473fa4e01141f754e1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:02Z,use_quota=True,user_id='82841529b9c949628b6fd2115cd5f872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Creating volume 2e211750-1e54-47af-817c-1031c3e3d880 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:02 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:02 devstack sudo[90127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880 1073741824
Jul 17 03:41:02 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880 1073741824" returned: 0 in 0.786s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:03 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:03 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880
Jul 17 03:41:03 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:03 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3a97e2-b819-4475-a677-76a7baf0fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e211750-1e54-47af-817c-1031c3e3d880', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44a1765-6c68-482c-be9c-0493e35dcff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Volume volume-2e211750-1e54-47af-817c-1031c3e3d880 (2e211750-1e54-47af-817c-1031c3e3d880): created successfully
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44a1765-6c68-482c-be9c-0493e35dcff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Flow 'volume_create_manager' (1f78c01b-65f4-44e5-9914-3c155ad6990e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f75e345d-2244-4947-8e36-2639d30ebb13 tempest-ServersNegativeTestJSON-1146044329 None] Created volume successfully.
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Flow 'volume_create_manager' (cfe53a0f-704b-412b-a1d5-d877fb3877ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b829234-3a05-4f59-a974-69c717715ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b829234-3a05-4f59-a974-69c717715ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-465494811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b28eb9e-6127-4399-9dba-cf1fe739e804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e042c70768473fa4e01141f754e1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:07Z,use_quota=True,user_id='82841529b9c949628b6fd2115cd5f872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e335b3fc-3db7-44f6-85f6-64e0c2511817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e335b3fc-3db7-44f6-85f6-64e0c2511817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b60496a-a618-4454-a565-879f16ed8b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b60496a-a618-4454-a565-879f16ed8b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b28eb9e-6127-4399-9dba-cf1fe739e804', 'volume_name': 'volume-2b28eb9e-6127-4399-9dba-cf1fe739e804', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c8dcb-2366-4cc9-a2bd-e5ee3305ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c8dcb-2366-4cc9-a2bd-e5ee3305ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d127645-4996-4747-8e97-a55f8846536a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Volume 2b28eb9e-6127-4399-9dba-cf1fe739e804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b28eb9e-6127-4399-9dba-cf1fe739e804', 'volume_size': 1}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-465494811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b28eb9e-6127-4399-9dba-cf1fe739e804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e042c70768473fa4e01141f754e1a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:07Z,use_quota=True,user_id='82841529b9c949628b6fd2115cd5f872',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Creating volume 2b28eb9e-6127-4399-9dba-cf1fe739e804 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:07 devstack sudo[90150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804 1073741824
Jul 17 03:41:07 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:08 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804 1073741824" returned: 0 in 0.687s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:08 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804
Jul 17 03:41:08 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:08 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d127645-4996-4747-8e97-a55f8846536a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b28eb9e-6127-4399-9dba-cf1fe739e804', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff06cb8-f651-4f66-895f-baaecb746a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Volume volume-2b28eb9e-6127-4399-9dba-cf1fe739e804 (2b28eb9e-6127-4399-9dba-cf1fe739e804): created successfully
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff06cb8-f651-4f66-895f-baaecb746a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Flow 'volume_create_manager' (cfe53a0f-704b-412b-a1d5-d877fb3877ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-925e178c-198d-4049-b6fc-b0f0b1daef62 tempest-ServersNegativeTestJSON-1146044329 None] Created volume successfully.
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Flow 'volume_create_manager' (9e74c0ac-6043-487e-a025-f2863f41244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcf2288-257f-485f-bc64-6c61500d74ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcf2288-257f-485f-bc64-6c61500d74ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-45926520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b847a4-3297-4bd1-809c-30ebd9dcd881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd34097978a44cd490429819ee4f2186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:09Z,use_quota=True,user_id='30549ead83674a1f929ea54e0dc983cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda380f4-8e0d-44d2-a845-9d9e3d809649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda380f4-8e0d-44d2-a845-9d9e3d809649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051ba197-4778-4d36-a74f-5bc9f529cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051ba197-4778-4d36-a74f-5bc9f529cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b847a4-3297-4bd1-809c-30ebd9dcd881', 'volume_name': 'volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a5bbe7-011e-48aa-b4ba-d9a6c3e0813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a5bbe7-011e-48aa-b4ba-d9a6c3e0813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45724240-759b-4ffe-9539-0d0c584579b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Volume e4b847a4-3297-4bd1-809c-30ebd9dcd881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881', 'volume_size': 1}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-45926520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b847a4-3297-4bd1-809c-30ebd9dcd881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd34097978a44cd490429819ee4f2186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:09Z,use_quota=True,user_id='30549ead83674a1f929ea54e0dc983cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Creating volume e4b847a4-3297-4bd1-809c-30ebd9dcd881 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:08 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:08 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881 1073741824
Jul 17 03:41:08 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:09 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881 1073741824" returned: 0 in 0.493s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:09 devstack sudo[90168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881
Jul 17 03:41:09 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:09 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45724240-759b-4ffe-9539-0d0c584579b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccea770-36f4-40f4-8c80-e2a9d050d04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Volume volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881 (e4b847a4-3297-4bd1-809c-30ebd9dcd881): created successfully
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ccea770-36f4-40f4-8c80-e2a9d050d04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Flow 'volume_create_manager' (9e74c0ac-6043-487e-a025-f2863f41244a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-92ea7a6d-a794-471e-acb1-d7d9d063dbb3 tempest-AttachVolumeShelveTestJSON-1347880235 None] Created volume successfully.
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "cinder-2b28eb9e-6127-4399-9dba-cf1fe739e804-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-2b28eb9e-6127-4399-9dba-cf1fe739e804-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "cinder-quobyte-2b28eb9e-6127-4399-9dba-cf1fe739e804" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-quobyte-2b28eb9e-6127-4399-9dba-cf1fe739e804" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76a2161-99b8-4fcd-b6ed-4712027af29e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:10 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804
Jul 17 03:41:10 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:10 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:10 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804
Jul 17 03:41:10 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:11 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2b28eb9e-6127-4399-9dba-cf1fe739e804" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-quobyte-2b28eb9e-6127-4399-9dba-cf1fe739e804" released by "delete_volume" :: held 0.816s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Created reservations ['80708873-d39f-4408-a150-bc915bbdc7cf', 'ddd0e91b-ba2a-4cd6-8b12-5af5d81ea1e7', '40f5d32b-727c-48f3-83c7-49dc7e96c30d', '6dd60e56-34d9-4aee-aa34-8881ee1ffa86'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:11 devstack sudo[90183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:11 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "cinder-2e211750-1e54-47af-817c-1031c3e3d880-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-2e211750-1e54-47af-817c-1031c3e3d880-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "cinder-quobyte-2e211750-1e54-47af-817c-1031c3e3d880" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-quobyte-2e211750-1e54-47af-817c-1031c3e3d880" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed58d40d-2578-4002-aa31-115c874b1f03]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:11 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Deleted volume successfully.
Jul 17 03:41:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dac7776c-2446-425c-a3d7-e5ff059cdacb tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-2b28eb9e-6127-4399-9dba-cf1fe739e804-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:11 devstack sudo[90185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880
Jul 17 03:41:11 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:12 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:12 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880
Jul 17 03:41:12 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:12 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:12 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:12 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:12 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e211750-1e54-47af-817c-1031c3e3d880" returned: 0 in 0.532s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-quobyte-2e211750-1e54-47af-817c-1031c3e3d880" released by "delete_volume" :: held 1.099s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Created reservations ['a4fa4f89-9ad2-46f7-8e68-f1bac07e6932', 'fb8836ba-b035-4738-8ae7-7a4fc3463cd2', '70dbaa30-aa2c-4452-8e74-a98ad5902f31', '2d4e377a-b9cb-4b67-8d57-e8b63cddc6c7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:12 devstack sudo[90200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:12 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:13 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Deleted volume successfully.
Jul 17 03:41:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f419e48-abe5-44cc-8ea3-9ecab2537657 tempest-ServersNegativeTestJSON-1146044329 None] Lock "cinder-2e211750-1e54-47af-817c-1031c3e3d880-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Flow 'volume_create_manager' (b17fbe80-3bb4-4cd6-b6e3-2e2ba72e3d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219cd82f-59a3-43be-906d-a2f763426659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219cd82f-59a3-43be-906d-a2f763426659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-592986222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f600db67-6b1f-48ea-b861-adf6bef13499,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f16879addb36448e9ac0f82e6a4a760a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:14Z,use_quota=True,user_id='39bc3ce9e9b6435d90ca0cfc2e72dcc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fd53a6-aead-4d73-8f2d-8e6998ec8134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fd53a6-aead-4d73-8f2d-8e6998ec8134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a46288c-bbeb-40c6-90a7-6e4cf0d6eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a46288c-bbeb-40c6-90a7-6e4cf0d6eba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f600db67-6b1f-48ea-b861-adf6bef13499', 'volume_name': 'volume-f600db67-6b1f-48ea-b861-adf6bef13499', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0a8768-b9d6-4eba-924b-8d44b2d10b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0a8768-b9d6-4eba-924b-8d44b2d10b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753e14d1-e245-4b20-9686-4f2f9a01b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Volume f600db67-6b1f-48ea-b861-adf6bef13499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f600db67-6b1f-48ea-b861-adf6bef13499', 'volume_size': 1}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-592986222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f600db67-6b1f-48ea-b861-adf6bef13499,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f16879addb36448e9ac0f82e6a4a760a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:14Z,use_quota=True,user_id='39bc3ce9e9b6435d90ca0cfc2e72dcc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Creating volume f600db67-6b1f-48ea-b861-adf6bef13499 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:14 devstack sudo[90233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499 1073741824
Jul 17 03:41:14 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:15 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499 1073741824" returned: 0 in 0.700s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:15 devstack sudo[90279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499
Jul 17 03:41:15 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:15 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753e14d1-e245-4b20-9686-4f2f9a01b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f600db67-6b1f-48ea-b861-adf6bef13499', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7894307a-992e-4665-b634-6bbb4b7464ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Volume volume-f600db67-6b1f-48ea-b861-adf6bef13499 (f600db67-6b1f-48ea-b861-adf6bef13499): created successfully
Jul 17 03:41:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7894307a-992e-4665-b634-6bbb4b7464ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Flow 'volume_create_manager' (b17fbe80-3bb4-4cd6-b6e3-2e2ba72e3d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-bd87856b-131f-4d65-b4a9-98ed6fc4bde9 req-1a3ccdfd-1b4d-4194-b5ad-d661088d268d tempest-VolumesGetTestJSON-1781591502 None] Created volume successfully.
Jul 17 03:41:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Acquiring lock "cinder-f600db67-6b1f-48ea-b861-adf6bef13499-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Lock "cinder-f600db67-6b1f-48ea-b861-adf6bef13499-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Acquiring lock "cinder-quobyte-f600db67-6b1f-48ea-b861-adf6bef13499" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Lock "cinder-quobyte-f600db67-6b1f-48ea-b861-adf6bef13499" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b330b403-c982-471b-832a-78763be12486]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:17 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499
Jul 17 03:41:17 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:18 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499" returned: 0 in 0.519s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:18 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499
Jul 17 03:41:18 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:18 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f600db67-6b1f-48ea-b861-adf6bef13499" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Lock "cinder-quobyte-f600db67-6b1f-48ea-b861-adf6bef13499" released by "delete_volume" :: held 0.977s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG cinder.quota [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Created reservations ['2146377c-1550-4d11-aa03-4166c63e3925', '857910bc-c37f-4068-ab26-d055798c2e48', 'e8fc0069-a4d4-4b96-9a31-1a23303b0b71', '2493b401-d9d5-4c1f-8f34-1cac3d037641'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:18 devstack sudo[90310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:18 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:18 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:18 devstack cinder-volume[87498]: DEBUG cinder.manager [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Deleted volume successfully.
Jul 17 03:41:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-8475efd2-4c3b-4f04-87cc-fd6a24c7b4b7 req-d0c414d4-01e6-4657-9567-d6b24d03dabd tempest-VolumesGetTestJSON-1781591502 None] Lock "cinder-f600db67-6b1f-48ea-b861-adf6bef13499-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Flow 'volume_create_manager' (babb524b-656d-4010-a6c5-1059fd6de1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1533e381-65cb-4541-82f0-465e515d741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1533e381-65cb-4541-82f0-465e515d741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1817607599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ded6e0ff449518a5f50529f9ba3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:23Z,use_quota=True,user_id='388b8a099fd84448a2e7344f4be4f299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a367f89-157a-408c-825b-28df48a7f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a367f89-157a-408c-825b-28df48a7f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54d988a-a23a-4e34-b6df-253e58fbb603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54d988a-a23a-4e34-b6df-253e58fbb603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec', 'volume_name': 'volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c96340e-4174-4fac-b1bf-bad52a4cc3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c96340e-4174-4fac-b1bf-bad52a4cc3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba30e6d-f54a-4c10-b562-4af88366edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Volume 7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec', 'volume_size': 1}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1817607599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ded6e0ff449518a5f50529f9ba3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:23Z,use_quota=True,user_id='388b8a099fd84448a2e7344f4be4f299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Creating volume 7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:23 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec 1073741824
Jul 17 03:41:23 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d86f4843-238d-4c90-abd0-146d39985c3d req-15ab1e2c-6e99-4bd2-aa94-97a351499b6d tempest-AttachVolumeShelveTestJSON-1347880235 None] No connector for attachment a5fffa79-803e-4061-9775-7e2e552b181c; skipping storage backend terminate_connection call. {{(pid=87498) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d86f4843-238d-4c90-abd0-146d39985c3d req-15ab1e2c-6e99-4bd2-aa94-97a351499b6d tempest-AttachVolumeShelveTestJSON-1347880235 None] Deleting attachment a5fffa79-803e-4061-9775-7e2e552b181c. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:41:23 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec 1073741824" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:24 devstack sudo[90343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec
Jul 17 03:41:24 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:24 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba30e6d-f54a-4c10-b562-4af88366edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ca38cc-2baa-4a9b-873f-2b6793f5d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Volume volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec (7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec): created successfully
Jul 17 03:41:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42ca38cc-2baa-4a9b-873f-2b6793f5d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Flow 'volume_create_manager' (babb524b-656d-4010-a6c5-1059fd6de1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8c2c77d9-a9d4-41ca-8ee2-279f292e3507 tempest-VolumesTestJSON-1970425561 None] Created volume successfully.
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Flow 'volume_create_manager' (45d0d956-264e-43f4-9078-4d2228611119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a2815e-b8d3-49e9-8aa0-83b25687e381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a2815e-b8d3-49e9-8aa0-83b25687e381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-58954881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a37acf-3fcc-43cb-9006-1ad5b975e86b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ded6e0ff449518a5f50529f9ba3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:26Z,use_quota=True,user_id='388b8a099fd84448a2e7344f4be4f299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b80ef4f-36d2-4430-86b1-7d8055e87082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b80ef4f-36d2-4430-86b1-7d8055e87082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ff3e1a-76c2-469c-9692-b4f02026743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ff3e1a-76c2-469c-9692-b4f02026743c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a37acf-3fcc-43cb-9006-1ad5b975e86b', 'volume_name': 'volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1dbf510-1261-465e-a68b-af634ff13a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1dbf510-1261-465e-a68b-af634ff13a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493dbcd1-9849-4525-8465-e9f9aa14708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Volume 31a37acf-3fcc-43cb-9006-1ad5b975e86b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b', 'volume_size': 1}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-58954881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a37acf-3fcc-43cb-9006-1ad5b975e86b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ded6e0ff449518a5f50529f9ba3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:26Z,use_quota=True,user_id='388b8a099fd84448a2e7344f4be4f299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Creating volume 31a37acf-3fcc-43cb-9006-1ad5b975e86b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:26 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:26 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b 1073741824
Jul 17 03:41:26 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Flow 'volume_create_manager' (3b481860-2358-4184-9c51-607ca80873f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faeebd52-a895-41df-8697-c7e2c3dcc909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faeebd52-a895-41df-8697-c7e2c3dcc909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1026897337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=103c80c5-4a85-462b-8f90-b942eb469137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2e2c5051dd4101846407b4dbe1f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:27Z,use_quota=True,user_id='c0b034fb9b134b27b4e832db38b6aefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512142e-33c7-4347-bfed-8c8661392e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512142e-33c7-4347-bfed-8c8661392e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9699978-9137-4ba7-b5fb-417eb1f43652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9699978-9137-4ba7-b5fb-417eb1f43652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '103c80c5-4a85-462b-8f90-b942eb469137', 'volume_name': 'volume-103c80c5-4a85-462b-8f90-b942eb469137', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2fe35c-9425-4e28-8cc9-da2e4a219a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2fe35c-9425-4e28-8cc9-da2e4a219a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca33c85-fdb8-4d8e-83e8-3eec4eec1654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Volume 103c80c5-4a85-462b-8f90-b942eb469137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-103c80c5-4a85-462b-8f90-b942eb469137', 'volume_size': 1}
Jul 17 03:41:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:27 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b 1073741824" returned: 0 in 0.618s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:27 devstack sudo[90395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b
Jul 17 03:41:27 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Flow 'volume_create_manager' (57559820-692d-4287-a3fd-a28c63fcbfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9f5d3-b6ef-41ea-bb17-2393a7f31753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf9f5d3-b6ef-41ea-bb17-2393a7f31753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1403567860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d4f46b-0a11-4ec1-b2f1-9575724e93db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da89bd8bb349139e8fa8edd6d3f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:27Z,use_quota=True,user_id='eb5d78499fb64090bbdf0577a4cfca22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596fca12-a2f4-47c5-b919-c036b876a444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596fca12-a2f4-47c5-b919-c036b876a444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6d1612-8ba3-49cc-8d96-9ee5246a8440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e6d1612-8ba3-49cc-8d96-9ee5246a8440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d4f46b-0a11-4ec1-b2f1-9575724e93db', 'volume_name': 'volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83995088-9ff1-4c5c-94ae-dc9b90d9e9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83995088-9ff1-4c5c-94ae-dc9b90d9e9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1174526b-494f-4a52-b2f1-2484369008bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Volume 79d4f46b-0a11-4ec1-b2f1-9575724e93db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db', 'volume_size': 1}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:27 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1026897337',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=103c80c5-4a85-462b-8f90-b942eb469137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2e2c5051dd4101846407b4dbe1f221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:27Z,use_quota=True,user_id='c0b034fb9b134b27b4e832db38b6aefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Creating volume 103c80c5-4a85-462b-8f90-b942eb469137 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:27 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493dbcd1-9849-4525-8465-e9f9aa14708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:27 devstack sudo[90399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137 1073741824
Jul 17 03:41:27 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09800c9f-1b14-4272-9116-6e90a8aab737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Volume volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b (31a37acf-3fcc-43cb-9006-1ad5b975e86b): created successfully
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09800c9f-1b14-4272-9116-6e90a8aab737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Flow 'volume_create_manager' (45d0d956-264e-43f4-9078-4d2228611119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a434206e-f69b-4401-b1b4-66321a084e1f tempest-VolumesTestJSON-1970425561 None] Created volume successfully.
Jul 17 03:41:28 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137 1073741824" returned: 0 in 0.543s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:28 devstack sudo[90404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137
Jul 17 03:41:28 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:28 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1403567860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d4f46b-0a11-4ec1-b2f1-9575724e93db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36da89bd8bb349139e8fa8edd6d3f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:27Z,use_quota=True,user_id='eb5d78499fb64090bbdf0577a4cfca22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Creating volume 79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca33c85-fdb8-4d8e-83e8-3eec4eec1654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-103c80c5-4a85-462b-8f90-b942eb469137', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:28 devstack sudo[90407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db 1073741824
Jul 17 03:41:28 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255bfdc4-7ff3-4b12-8753-c64ce79f360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Volume volume-103c80c5-4a85-462b-8f90-b942eb469137 (103c80c5-4a85-462b-8f90-b942eb469137): created successfully
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255bfdc4-7ff3-4b12-8753-c64ce79f360d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Flow 'volume_create_manager' (3b481860-2358-4184-9c51-607ca80873f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-977f0c75-6764-4a70-a204-4216ca7b0c5b tempest-ServerActionsTestOtherA-1679357028 None] Created volume successfully.
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Flow 'volume_create_manager' (bca8c9ce-8aee-49ea-923d-b61deaa9578b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac42f324-58c9-4cb6-81a3-07ca704f2c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac42f324-58c9-4cb6-81a3-07ca704f2c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1292911167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937ac83e-c07e-4a78-a78e-f3412ef3c562,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ded6e0ff449518a5f50529f9ba3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:29Z,use_quota=True,user_id='388b8a099fd84448a2e7344f4be4f299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bec113-2282-465c-bb97-2f93c8862b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bec113-2282-465c-bb97-2f93c8862b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592048d7-bcd2-40df-adfd-27d4b18c407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592048d7-bcd2-40df-adfd-27d4b18c407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '937ac83e-c07e-4a78-a78e-f3412ef3c562', 'volume_name': 'volume-937ac83e-c07e-4a78-a78e-f3412ef3c562', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44b2d4c-75d0-429e-8dee-7ccf4b42403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44b2d4c-75d0-429e-8dee-7ccf4b42403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5b952f-da97-4cdf-b9d0-77660b30697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Volume 937ac83e-c07e-4a78-a78e-f3412ef3c562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-937ac83e-c07e-4a78-a78e-f3412ef3c562', 'volume_size': 1}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:29 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db 1073741824" returned: 0 in 0.573s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:29 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db
Jul 17 03:41:29 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:29 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1292911167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=937ac83e-c07e-4a78-a78e-f3412ef3c562,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ded6e0ff449518a5f50529f9ba3ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:29Z,use_quota=True,user_id='388b8a099fd84448a2e7344f4be4f299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Creating volume 937ac83e-c07e-4a78-a78e-f3412ef3c562 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:29 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562 1073741824
Jul 17 03:41:29 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1174526b-494f-4a52-b2f1-2484369008bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d3ea4d-b6f2-47b4-b4a8-7cb547e3430f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Volume volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db (79d4f46b-0a11-4ec1-b2f1-9575724e93db): created successfully
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d3ea4d-b6f2-47b4-b4a8-7cb547e3430f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Flow 'volume_create_manager' (57559820-692d-4287-a3fd-a28c63fcbfee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-736ac449-fcb8-45e7-bd1e-cfa9e03aa59b req-3c29aea6-a86d-41b6-a8da-311d9c0ad5bc tempest-VolumesSnapshotsTestJSON-1194644788 None] Created volume successfully.
Jul 17 03:41:30 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562 1073741824" returned: 0 in 0.641s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:30 devstack sudo[90424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562
Jul 17 03:41:30 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:30 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.293s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5b952f-da97-4cdf-b9d0-77660b30697b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-937ac83e-c07e-4a78-a78e-f3412ef3c562', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcacc408-8226-4524-8da5-4ee6ac372c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Creating offline snapshot e83e83b9-b308-4760-a489-6f788af63734 of volume 79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:41:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Volume volume-937ac83e-c07e-4a78-a78e-f3412ef3c562 (937ac83e-c07e-4a78-a78e-f3412ef3c562): created successfully
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcacc408-8226-4524-8da5-4ee6ac372c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Flow 'volume_create_manager' (bca8c9ce-8aee-49ea-923d-b61deaa9578b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78f7ed9-a494-443d-bffe-8a5c7ad55ad8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7b3d7065-0239-4e4d-aa95-46611c90b2e8 tempest-VolumesTestJSON-1970425561 None] Created volume successfully.
Jul 17 03:41:30 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db
Jul 17 03:41:30 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:31 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:31 devstack sudo[90436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 1G
Jul 17 03:41:31 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:31 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 1G" returned: 0 in 0.572s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:31 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734
Jul 17 03:41:31 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:32 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:32 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 is being set with open permissions: ugo+rw
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:32 devstack sudo[90459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734
Jul 17 03:41:32 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:32 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:32 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.info
Jul 17 03:41:32 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "cinder-937ac83e-c07e-4a78-a78e-f3412ef3c562-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-937ac83e-c07e-4a78-a78e-f3412ef3c562-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "cinder-quobyte-937ac83e-c07e-4a78-a78e-f3412ef3c562" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-quobyte-937ac83e-c07e-4a78-a78e-f3412ef3c562" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bc8fec-573d-4ebe-8570-819f6bc07d9c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:32 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562
Jul 17 03:41:32 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:32 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.info" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:33 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.info is being set with open permissions: ugo+rw
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:33 devstack sudo[90490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.info
Jul 17 03:41:33 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:33 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562" returned: 0 in 0.622s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:33 devstack sudo[90510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562
Jul 17 03:41:33 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:33 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.info" returned: 0 in 0.529s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.990s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-cae8035d-c5c8-4216-bcd7-b0a1bd7b289e req-fa469fd6-20fb-4159-a3ef-e9218b6dea86 tempest-VolumesSnapshotsTestJSON-1194644788 None] Create snapshot completed successfully
Jul 17 03:41:33 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-937ac83e-c07e-4a78-a78e-f3412ef3c562" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-quobyte-937ac83e-c07e-4a78-a78e-f3412ef3c562" released by "delete_volume" :: held 1.002s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Created reservations ['c959538f-9672-4d8c-adda-77f8795cf8d8', 'b69614b8-9e5a-4fbd-b4a2-05cfcc0633c4', 'c240c24a-997e-455d-97a5-79beaa64cf23', 'ce2660f7-0b42-4a94-a380-1cd6ba8b550d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:34 devstack sudo[90514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:34 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:34 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Deleted volume successfully.
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-583709de-67ac-46fa-81db-222a25e9f0b8 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-937ac83e-c07e-4a78-a78e-f3412ef3c562-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "cinder-e83e83b9-b308-4760-a489-6f788af63734-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-e83e83b9-b308-4760-a489-6f788af63734-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "cinder-quobyte-79d4f46b-0a11-4ec1-b2f1-9575724e93db" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-quobyte-79d4f46b-0a11-4ec1-b2f1-9575724e93db" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "cinder-quobyte-e83e83b9-b308-4760-a489-6f788af63734" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-quobyte-e83e83b9-b308-4760-a489-6f788af63734" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Deleting offline snapshot e83e83b9-b308-4760-a489-6f788af63734 of volume 79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] snapshot_file for this snap is: volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e096931-a8e7-43e3-abe4-4b22a24885f8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:34 devstack sudo[90517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734
Jul 17 03:41:34 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "cinder-31a37acf-3fcc-43cb-9006-1ad5b975e86b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-31a37acf-3fcc-43cb-9006-1ad5b975e86b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "cinder-quobyte-31a37acf-3fcc-43cb-9006-1ad5b975e86b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-quobyte-31a37acf-3fcc-43cb-9006-1ad5b975e86b" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56f650-dede-48cd-be6b-d3903b8fa40e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:35 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734" returned: 0 in 0.601s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e41ac83-6be4-4cef-ab88-a69d8e447abc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:35 devstack sudo[90524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b
Jul 17 03:41:35 devstack sudo[90524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:35 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db
Jul 17 03:41:35 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:35 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db" returned: 0 in 0.559s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:35 devstack sudo[90524]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b" returned: 0 in 0.707s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:35 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734
Jul 17 03:41:35 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:36 devstack sudo[90552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b
Jul 17 03:41:36 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:36 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-31a37acf-3fcc-43cb-9006-1ad5b975e86b" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-quobyte-31a37acf-3fcc-43cb-9006-1ad5b975e86b" released by "delete_volume" :: held 1.247s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Created reservations ['2f1ed386-1a0d-42c9-a5c2-24e1a71c6750', '5d833dd7-b8da-4f73-8a81-02a43af2a0a8', '6af3ba21-cef4-4ea8-b561-ca4f5117b6c8', 'a6ea5417-017c-409e-a8fc-ce4527c09839'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:36 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734" returned: 0 in 0.652s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:36 devstack sudo[90601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734
Jul 17 03:41:36 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:36 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:36 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:37 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db.e83e83b9-b308-4760-a489-6f788af63734" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:37 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.547s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-quobyte-e83e83b9-b308-4760-a489-6f788af63734" released by "_delete_snapshot" :: held 2.627s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-quobyte-79d4f46b-0a11-4ec1-b2f1-9575724e93db" released by "delete_snapshot" :: held 2.667s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Deleted volume successfully.
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-830ea129-f6be-4f3c-98c3-15d8e6b56023 tempest-VolumesTestJSON-1970425561 None] Lock "cinder-31a37acf-3fcc-43cb-9006-1ad5b975e86b-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:37 devstack cinder-volume[87498]: WARNING cinder.quota [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.quota [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Created reservations ['134c84a4-f759-4a73-9549-00dc2edf2a5a', '8134bfc0-59bb-43d8-8904-cdd20be5f6e4', 'deca3dc0-afd2-42b9-8d01-c12d8b5e89a1', 'a45c8876-6d50-4b2a-b18a-b4f97b76d624'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Acquiring lock "cinder-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Lock "cinder-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Delete snapshot completed successfully.
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-dc9dfa98-2117-46ff-b4b6-7b88e990bce3 req-4121171d-2174-47d5-a64d-a4dabcdf64a7 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-e83e83b9-b308-4760-a489-6f788af63734-delete_snapshot" released by "delete_snapshot" :: held 3.069s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Acquiring lock "cinder-quobyte-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Lock "cinder-quobyte-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34149b1a-2df2-40d4-8603-d1c583b5ca11]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:37 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec
Jul 17 03:41:37 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "cinder-79d4f46b-0a11-4ec1-b2f1-9575724e93db-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-79d4f46b-0a11-4ec1-b2f1-9575724e93db-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "cinder-quobyte-79d4f46b-0a11-4ec1-b2f1-9575724e93db" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:38 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec" returned: 0 in 0.634s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-quobyte-79d4f46b-0a11-4ec1-b2f1-9575724e93db" acquired by "delete_volume" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:38 devstack sudo[90662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec
Jul 17 03:41:38 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13153c9-4161-4d1e-840c-f26aa1997177]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:38 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db
Jul 17 03:41:38 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:39 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec" returned: 0 in 0.606s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Lock "cinder-quobyte-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec" released by "delete_volume" :: held 1.324s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Created reservations ['21d31ecb-96db-4e9f-b79f-4e83dcedb6b6', 'a68ee741-04c5-4092-be5a-178ac391606a', '40c92885-bc6e-49c6-abe1-c0469f5a81e3', '1eb3b6e7-9346-42d4-b180-32050348954f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:39 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db" returned: 0 in 0.666s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:39 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:39 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:39 devstack sudo[90673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db
Jul 17 03:41:39 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:39 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Deleted volume successfully.
Jul 17 03:41:39 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-79d4f46b-0a11-4ec1-b2f1-9575724e93db" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc18e78c-3014-482c-972f-abbe15379c0f tempest-VolumesTestJSON-1970425561 None] Lock "cinder-7f38bd1d-21ec-4e3f-92b9-3cc49a5296ec-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-quobyte-79d4f46b-0a11-4ec1-b2f1-9575724e93db" released by "delete_volume" :: held 1.176s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.quota [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Created reservations ['1e3daf56-b1b8-4a31-8ed6-892e49bdb555', 'de24703c-bd04-496b-859b-8a72399ce9d5', '0e79dd01-6f16-46ae-aaf2-ed14e9d44ce8', '55d257cf-c3fa-4500-b345-cdb76087d7d5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:40 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:41:40 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:40 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.675s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:40 devstack cinder-volume[87498]: DEBUG cinder.manager [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:41:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Deleted volume successfully.
Jul 17 03:41:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-01cc013d-97d8-4606-aff4-234341164868 req-f3c11660-2e9e-42b0-8fb3-5cfba17e24a9 tempest-VolumesSnapshotsTestJSON-1194644788 None] Lock "cinder-79d4f46b-0a11-4ec1-b2f1-9575724e93db-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:41:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4a68b9f4-87f0-4caf-b5b4-e1a0827ed19f tempest-GroupsV314Test-952781992 None] Group tempest-GroupsV314Test-Group-752592600: creating
Jul 17 03:41:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4a68b9f4-87f0-4caf-b5b4-e1a0827ed19f tempest-GroupsV314Test-952781992 None] Group tempest-GroupsV314Test-Group-752592600: created successfully
Jul 17 03:41:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4a68b9f4-87f0-4caf-b5b4-e1a0827ed19f tempest-GroupsV314Test-952781992 None] Create group completed successfully.
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Flow 'volume_create_manager' (1b6c90d7-1f98-4ebf-bfba-4140ee899318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5161be-54e7-4056-9fe8-827b242091f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5161be-54e7-4056-9fe8-827b242091f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-292001077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f224dd3d-02d1-4621-ab8b-30d2843162b0,host='devstack@QuobyteHD#QuobyteHD',id=b30b9156-44b6-4f4e-833f-d5cbe42b2df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3749cbaa2aee432f8bf601d473a9c439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:49Z,use_quota=True,user_id='ba72c62a3abd467aa474e02aafb6c759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43246fcc-947c-4d3c-a564-dbccda6381a3),volume_type_id=43246fcc-947c-4d3c-a564-dbccda6381a3)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd19854-7532-4cfb-a845-1385a1f37b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd19854-7532-4cfb-a845-1385a1f37b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcae4dd-e8cc-4209-87d1-38450aec5a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efcae4dd-e8cc-4209-87d1-38450aec5a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b30b9156-44b6-4f4e-833f-d5cbe42b2df5', 'volume_name': 'volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756fd0d8-9e3b-47e1-96ae-db6d0894f182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756fd0d8-9e3b-47e1-96ae-db6d0894f182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a595c0-922b-4b2d-bbaf-c1699e59535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Volume b30b9156-44b6-4f4e-833f-d5cbe42b2df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5', 'volume_size': 1}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f224dd3d-02d1-4621-ab8b-30d2843162b0,created_at=2026-07-17T01:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-292001077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f224dd3d-02d1-4621-ab8b-30d2843162b0,host='devstack@QuobyteHD#QuobyteHD',id=b30b9156-44b6-4f4e-833f-d5cbe42b2df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3749cbaa2aee432f8bf601d473a9c439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:41:49Z,use_quota=True,user_id='ba72c62a3abd467aa474e02aafb6c759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43246fcc-947c-4d3c-a564-dbccda6381a3),volume_type_id=43246fcc-947c-4d3c-a564-dbccda6381a3)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Creating volume b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:41:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:41:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:49 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 1073741824
Jul 17 03:41:49 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:50 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 1073741824" returned: 0 in 0.540s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:50 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5
Jul 17 03:41:50 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:50 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a595c0-922b-4b2d-bbaf-c1699e59535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6fdadc-c93a-4b64-8533-e55941c32e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:41:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Volume volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 (b30b9156-44b6-4f4e-833f-d5cbe42b2df5): created successfully
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a6fdadc-c93a-4b64-8533-e55941c32e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:41:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Flow 'volume_create_manager' (1b6c90d7-1f98-4ebf-bfba-4140ee899318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:41:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-49f5c30c-b78a-4b63-9063-74f63574b7b3 tempest-GroupsV314Test-952781992 None] Created volume successfully.
Jul 17 03:41:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=80,cinder:INSERT=21,cinder:UPDATE=91,cinder:DELETE=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:41:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=113,cinder:SELECT=68,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:41:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Cloning volume b30b9156-44b6-4f4e-833f-d5cbe42b2df5 to volume cc26e64f-09e2-47b8-b10a-fefdd74179f8
Jul 17 03:41:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Creating offline snapshot 2b6524cc-224f-4855-99f1-3a3fdc27d0b2 of volume b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:41:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d157d9d-9ae2-4849-b55e-f682b3c8b7b3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:53 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5
Jul 17 03:41:53 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:53 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:53 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 1G
Jul 17 03:41:53 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:54 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 1G" returned: 0 in 0.463s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:54 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2
Jul 17 03:41:54 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:54 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:41:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:54 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2
Jul 17 03:41:54 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:54 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:54 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.info
Jul 17 03:41:54 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:55 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.info" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:55 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.info
Jul 17 03:41:55 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:55 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.info" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Acquiring lock "cinder-quobyte-cc26e64f-09e2-47b8-b10a-fefdd74179f8" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-cc26e64f-09e2-47b8-b10a-fefdd74179f8" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] snapshot: 2b6524cc-224f-4855-99f1-3a3fdc27d0b2, volume: cc26e64f-09e2-47b8-b10a-fefdd74179f8,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8ee6fc-8813-4489-bf03-aac97a50fac1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:55 devstack sudo[90731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2
Jul 17 03:41:55 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:55 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c73a43-006b-49e1-b95d-54212af393e7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:41:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:56 devstack sudo[90736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5
Jul 17 03:41:56 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:41:56 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root
Jul 17 03:41:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:41:56 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:41:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:41:56 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8
Jul 17 03:41:56 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:01 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8f7796c5-def6-44c1-ac93-c87b03768854 tempest-GroupsTest-5032705 None] Group tempest-Group1-2107739489: creating
Jul 17 03:42:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8" returned: 0 in 5.501s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6866d4d5-920c-4ed8-b422-fe6ae43e4932]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8f7796c5-def6-44c1-ac93-c87b03768854 tempest-GroupsTest-5032705 None] Group tempest-Group1-2107739489: created successfully
Jul 17 03:42:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8f7796c5-def6-44c1-ac93-c87b03768854 tempest-GroupsTest-5032705 None] Create group completed successfully.
Jul 17 03:42:01 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5
Jul 17 03:42:01 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:02 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:42:02 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Converted 1024.00 MB image at 186.09 MB/s
Jul 17 03:42:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8 is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:02 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8
Jul 17 03:42:02 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:02 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-cc26e64f-09e2-47b8-b10a-fefdd74179f8" released by "_copy_volume_from_snapshot" :: held 7.295s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Acquiring lock "cinder-quobyte-2b6524cc-224f-4855-99f1-3a3fdc27d0b2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-2b6524cc-224f-4855-99f1-3a3fdc27d0b2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Deleting offline snapshot 2b6524cc-224f-4855-99f1-3a3fdc27d0b2 of volume b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] snapshot_file for this snap is: volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[057820da-d28c-45de-adb0-1ee2108df523]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:02 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2
Jul 17 03:42:02 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-324f17d4-5c2d-4d36-bce0-c1445e859f00 tempest-GroupsTest-5032705 None] Group tempest-Group2-960046646: creating
Jul 17 03:42:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-324f17d4-5c2d-4d36-bce0-c1445e859f00 tempest-GroupsTest-5032705 None] Group tempest-Group2-960046646: created successfully
Jul 17 03:42:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-324f17d4-5c2d-4d36-bce0-c1445e859f00 tempest-GroupsTest-5032705 None] Create group completed successfully.
Jul 17 03:42:03 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2" returned: 0 in 0.624s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac30cf3-2d66-4513-a172-b810806b07ce]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:03 devstack sudo[90829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5
Jul 17 03:42:03 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:03 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:03 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2
Jul 17 03:42:03 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:04 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:04 devstack sudo[90844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2
Jul 17 03:42:04 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:04 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5.2b6524cc-224f-4855-99f1-3a3fdc27d0b2" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-2b6524cc-224f-4855-99f1-3a3fdc27d0b2" released by "_delete_snapshot" :: held 1.962s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.822s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a16cee1c-2cf1-471d-9234-e51177eb1a5f tempest-GroupsV314Test-952781992 None] Create group from source-group-f224dd3d-02d1-4621-ab8b-30d2843162b0 completed successfully.
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Flow 'volume_create_manager' (9a39c2cf-6bb4-4d94-978b-60da69b2abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c08798d-f124-40fa-a05d-203ba9341147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c08798d-f124-40fa-a05d-203ba9341147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062921787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98667e0b-a056-4f08-a78d-b9442836b09b,host='devstack@QuobyteHD#QuobyteHD',id=6ba664ba-779f-4810-a0ac-694c5ff6c68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70653c08b9a144f89f746ecac495aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:05Z,use_quota=True,user_id='96e68f3acb134ed299bbb6d81625b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ad926d-0cae-4bcd-9772-fb726f39efcb),volume_type_id=11ad926d-0cae-4bcd-9772-fb726f39efcb)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a945dd9-c9fb-4f4c-8d33-eef207ebb9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a945dd9-c9fb-4f4c-8d33-eef207ebb9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456c24b2-03e1-4aae-9dd0-dad1dbc76513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (456c24b2-03e1-4aae-9dd0-dad1dbc76513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba664ba-779f-4810-a0ac-694c5ff6c68b', 'volume_name': 'volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472bfbf4-5e30-4cb5-97fa-01421314f353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472bfbf4-5e30-4cb5-97fa-01421314f353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f61b8c-ebb0-4fc3-9087-3a06bb1ecdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Volume 6ba664ba-779f-4810-a0ac-694c5ff6c68b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b', 'volume_size': 1}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=98667e0b-a056-4f08-a78d-b9442836b09b,created_at=2026-07-17T01:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1062921787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=98667e0b-a056-4f08-a78d-b9442836b09b,host='devstack@QuobyteHD#QuobyteHD',id=6ba664ba-779f-4810-a0ac-694c5ff6c68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70653c08b9a144f89f746ecac495aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:05Z,use_quota=True,user_id='96e68f3acb134ed299bbb6d81625b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11ad926d-0cae-4bcd-9772-fb726f39efcb),volume_type_id=11ad926d-0cae-4bcd-9772-fb726f39efcb)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Creating volume 6ba664ba-779f-4810-a0ac-694c5ff6c68b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:05 devstack sudo[90852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b 1073741824
Jul 17 03:42:05 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:05 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b 1073741824" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:05 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b
Jul 17 03:42:05 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:06 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f61b8c-ebb0-4fc3-9087-3a06bb1ecdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8482610-c012-46e6-a943-1cf1028f6629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Volume volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b (6ba664ba-779f-4810-a0ac-694c5ff6c68b): created successfully
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8482610-c012-46e6-a943-1cf1028f6629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Flow 'volume_create_manager' (9a39c2cf-6bb4-4d94-978b-60da69b2abfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-47391aa6-56ed-4cce-bb02-072e64c00014 tempest-GroupsTest-5032705 None] Created volume successfully.
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Acquiring lock "cinder-quobyte-cc26e64f-09e2-47b8-b10a-fefdd74179f8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-cc26e64f-09e2-47b8-b10a-fefdd74179f8" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3d87c2-5403-4cf6-bcd9-6d68d65c4c96]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:06 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8
Jul 17 03:42:06 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:06 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:06 devstack sudo[90867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8
Jul 17 03:42:06 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:07 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cc26e64f-09e2-47b8-b10a-fefdd74179f8" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Acquiring lock "cinder-quobyte-6ba664ba-779f-4810-a0ac-694c5ff6c68b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-cc26e64f-09e2-47b8-b10a-fefdd74179f8" released by "delete_volume" :: held 0.844s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Lock "cinder-quobyte-6ba664ba-779f-4810-a0ac-694c5ff6c68b" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[59255682-184a-47a2-819d-69d356227d22]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Created reservations ['051ac069-4b95-4071-9232-d0ca56bcd70a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:07 devstack cinder-volume[87498]: WARNING cinder.quota [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-560508420 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-560508420, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:07 devstack cinder-volume[87498]: WARNING cinder.quota [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-560508420 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-560508420, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Created reservations ['86503125-b18a-4678-a262-dc650ec6342a', '3db7081c-bfa1-470c-a7a1-5230aef45932', 'fb35ae91-3159-4170-90da-e5293e8603a3', '92b5083e-6f16-41a3-baf7-156960e3ec83'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:07 devstack sudo[90870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b
Jul 17 03:42:07 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:07 devstack sudo[90872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:07 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:07 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Acquiring lock "cinder-e4b847a4-3297-4bd1-809c-30ebd9dcd881-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b" returned: 0 in 0.470s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:07 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:07 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b
Jul 17 03:42:07 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "cinder-e4b847a4-3297-4bd1-809c-30ebd9dcd881-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1852e5f3-ebe1-48a7-a238-18ef06490cad tempest-GroupsV314Test-952781992 None] Delete group completed successfully.
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Acquiring lock "cinder-quobyte-e4b847a4-3297-4bd1-809c-30ebd9dcd881" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "cinder-quobyte-e4b847a4-3297-4bd1-809c-30ebd9dcd881" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e4df02-d74f-47b3-8a52-e64b5cb8c6a5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Acquiring lock "cinder-quobyte-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:08 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881
Jul 17 03:42:08 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b0d00e-9a94-437d-bdf2-e39a34567ad1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:08 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6ba664ba-779f-4810-a0ac-694c5ff6c68b" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Lock "cinder-quobyte-6ba664ba-779f-4810-a0ac-694c5ff6c68b" released by "delete_volume" :: held 0.863s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:08 devstack sudo[90883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5
Jul 17 03:42:08 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Created reservations ['a9b3b1c4-036f-4dc9-b974-bcf7dbd076b8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:08 devstack cinder-volume[87498]: WARNING cinder.quota [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1220961792 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1220961792, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:08 devstack cinder-volume[87498]: WARNING cinder.quota [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1220961792 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1220961792, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Created reservations ['1d011c19-d457-4960-880f-c35ce4146607', 'c1b4bb99-d4f1-408b-956e-233e97cf1df9', 'e267427e-d5c6-41ec-af92-ba8dcca8507f', '83ce91eb-1be1-489a-bd1d-74113c5233eb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:08 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:08 devstack sudo[90888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881
Jul 17 03:42:08 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:08 devstack sudo[90892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:08 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:08 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:08 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5
Jul 17 03:42:08 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:08 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e4b847a4-3297-4bd1-809c-30ebd9dcd881" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "cinder-quobyte-e4b847a4-3297-4bd1-809c-30ebd9dcd881" released by "delete_volume" :: held 0.776s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Created reservations ['d154e3d4-d8bb-484d-9bc1-ec0b8b607485'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:08 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c937ff9e-0bce-4f46-bb8d-b226867d22a1 tempest-GroupsTest-5032705 None] Delete group completed successfully.
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Created reservations ['938026c6-9ba2-44e8-9e96-adfc6cc8fbd0', '5153ec01-f341-426e-aed0-b37d00d06929', '4c75d769-b105-4cd5-a6a7-e8ee6735458d', '927577ff-7efd-40ba-8c1f-56055321c8b3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:08 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:08 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:08 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Lock "cinder-quobyte-b30b9156-44b6-4f4e-833f-d5cbe42b2df5" released by "delete_volume" :: held 0.826s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:08 devstack sudo[90902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:08 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Created reservations ['fd86d562-1c88-404c-a00c-03f2f1ee6818'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Created reservations ['1075252e-65fa-45cc-a41c-480233579c7c', 'b883360d-8f60-4f83-b588-8a523eafd7cb', 'dfdc9e0e-cfbf-44e1-b823-ceccda011588', 'b9e32572-c2a5-404c-a074-c62855d0a0ec'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:09 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-616c34f9-470d-462f-8ced-e4e519b5dd81 tempest-GroupsTest-5032705 None] Delete group completed successfully.
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:09 devstack sudo[90905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:09 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:09 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Deleted volume successfully.
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ac0c2f54-3b5c-4889-a310-61e13db6fd23 tempest-AttachVolumeShelveTestJSON-1347880235 None] Lock "cinder-e4b847a4-3297-4bd1-809c-30ebd9dcd881-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:09 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f1143f0-8c41-4996-89f9-de8dc106c4db tempest-GroupsV314Test-952781992 None] Delete group completed successfully.
Jul 17 03:42:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d04ccccf-a1b6-4054-911a-d88a290346bc tempest-GroupsTest-5032705 None] Group tempest-GroupsTest-Group-752235999: creating
Jul 17 03:42:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d04ccccf-a1b6-4054-911a-d88a290346bc tempest-GroupsTest-5032705 None] Group tempest-GroupsTest-Group-752235999: created successfully
Jul 17 03:42:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d04ccccf-a1b6-4054-911a-d88a290346bc tempest-GroupsTest-5032705 None] Create group completed successfully.
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Flow 'volume_create_manager' (7ce3f5f7-4282-4695-8644-005282812bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbf8296-4e6e-4ea6-8e6c-4f4f660e3b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bbf8296-4e6e-4ea6-8e6c-4f4f660e3b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-272714976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=014d20c9-10ec-4e40-a053-66e5765e5d3a,host='devstack@QuobyteHD#QuobyteHD',id=89197df2-df85-420d-842e-44a4240ed842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70653c08b9a144f89f746ecac495aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:12Z,use_quota=True,user_id='96e68f3acb134ed299bbb6d81625b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b4d49c1-6868-44bb-8f7d-85714ab1a4a5),volume_type_id=0b4d49c1-6868-44bb-8f7d-85714ab1a4a5)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cab7ee-65a5-4577-8c1e-6cc0ba074405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cab7ee-65a5-4577-8c1e-6cc0ba074405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196fae5-cf70-4593-afdf-9ca8e48e2bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196fae5-cf70-4593-afdf-9ca8e48e2bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89197df2-df85-420d-842e-44a4240ed842', 'volume_name': 'volume-89197df2-df85-420d-842e-44a4240ed842', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537b0b2e-ff12-4f0c-b91e-42cc0070741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537b0b2e-ff12-4f0c-b91e-42cc0070741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bf8ccf-e8f4-44ea-a259-b313b3ca72e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Volume 89197df2-df85-420d-842e-44a4240ed842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89197df2-df85-420d-842e-44a4240ed842', 'volume_size': 1}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=014d20c9-10ec-4e40-a053-66e5765e5d3a,created_at=2026-07-17T01:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-272714976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=014d20c9-10ec-4e40-a053-66e5765e5d3a,host='devstack@QuobyteHD#QuobyteHD',id=89197df2-df85-420d-842e-44a4240ed842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70653c08b9a144f89f746ecac495aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:12Z,use_quota=True,user_id='96e68f3acb134ed299bbb6d81625b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b4d49c1-6868-44bb-8f7d-85714ab1a4a5),volume_type_id=0b4d49c1-6868-44bb-8f7d-85714ab1a4a5)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Creating volume 89197df2-df85-420d-842e-44a4240ed842 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:12 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:12 devstack sudo[90910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842 1073741824
Jul 17 03:42:12 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:12 devstack sudo[90911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:12 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:12 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:42:12 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842 1073741824" returned: 0 in 0.568s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:12 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842
Jul 17 03:42:12 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:13 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bf8ccf-e8f4-44ea-a259-b313b3ca72e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89197df2-df85-420d-842e-44a4240ed842', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d97515f-2ab1-4031-9d3c-792d27407be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Volume volume-89197df2-df85-420d-842e-44a4240ed842 (89197df2-df85-420d-842e-44a4240ed842): created successfully
Jul 17 03:42:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d97515f-2ab1-4031-9d3c-792d27407be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Flow 'volume_create_manager' (7ce3f5f7-4282-4695-8644-005282812bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-50c46267-1349-4634-916b-d2da823ac91e tempest-GroupsTest-5032705 None] Created volume successfully.
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Flow 'volume_create_manager' (746624cb-d002-4c0b-add8-ce7bbe43d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda461f8-0445-4673-b3d9-2bc2f1074a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda461f8-0445-4673-b3d9-2bc2f1074a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-307667090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=014d20c9-10ec-4e40-a053-66e5765e5d3a,host='devstack@QuobyteHD#QuobyteHD',id=a8dace02-453d-4a89-a9cb-5120e7f9b393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70653c08b9a144f89f746ecac495aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:15Z,use_quota=True,user_id='96e68f3acb134ed299bbb6d81625b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b4d49c1-6868-44bb-8f7d-85714ab1a4a5),volume_type_id=0b4d49c1-6868-44bb-8f7d-85714ab1a4a5)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9b5db5-9563-4cfd-a75e-b57c1f90efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9b5db5-9563-4cfd-a75e-b57c1f90efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b366cb-8f0c-4290-bea1-0170f390a889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b366cb-8f0c-4290-bea1-0170f390a889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8dace02-453d-4a89-a9cb-5120e7f9b393', 'volume_name': 'volume-a8dace02-453d-4a89-a9cb-5120e7f9b393', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231e09ab-1b54-4be7-bdb6-3c178b75afd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231e09ab-1b54-4be7-bdb6-3c178b75afd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb566ea2-3e93-4429-a53f-b240bc1f21b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Volume a8dace02-453d-4a89-a9cb-5120e7f9b393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8dace02-453d-4a89-a9cb-5120e7f9b393', 'volume_size': 1}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=014d20c9-10ec-4e40-a053-66e5765e5d3a,created_at=2026-07-17T01:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-307667090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=014d20c9-10ec-4e40-a053-66e5765e5d3a,host='devstack@QuobyteHD#QuobyteHD',id=a8dace02-453d-4a89-a9cb-5120e7f9b393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70653c08b9a144f89f746ecac495aa49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:15Z,use_quota=True,user_id='96e68f3acb134ed299bbb6d81625b8eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b4d49c1-6868-44bb-8f7d-85714ab1a4a5),volume_type_id=0b4d49c1-6868-44bb-8f7d-85714ab1a4a5)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Creating volume a8dace02-453d-4a89-a9cb-5120e7f9b393 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:15 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393 1073741824
Jul 17 03:42:15 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1074a634-80e6-4174-b681-d1e06d8660fa tempest-GroupsV320Test-613601063 None] Group tempest-GroupsV320Test-Group-1808369326: creating
Jul 17 03:42:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1074a634-80e6-4174-b681-d1e06d8660fa tempest-GroupsV320Test-613601063 None] Group tempest-GroupsV320Test-Group-1808369326: created successfully
Jul 17 03:42:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1074a634-80e6-4174-b681-d1e06d8660fa tempest-GroupsV320Test-613601063 None] Create group completed successfully.
Jul 17 03:42:15 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393 1073741824" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:15 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393
Jul 17 03:42:15 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:15 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb566ea2-3e93-4429-a53f-b240bc1f21b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8dace02-453d-4a89-a9cb-5120e7f9b393', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6164db32-44cc-48f9-ae80-faef495dee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Volume volume-a8dace02-453d-4a89-a9cb-5120e7f9b393 (a8dace02-453d-4a89-a9cb-5120e7f9b393): created successfully
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6164db32-44cc-48f9-ae80-faef495dee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Flow 'volume_create_manager' (746624cb-d002-4c0b-add8-ce7bbe43d673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-35c35fa3-6111-4e1a-a343-f917dab774ed tempest-GroupsTest-5032705 None] Created volume successfully.
Jul 17 03:42:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c685ad6c-1ba2-4d52-8aae-e89e02e54bdc tempest-BackendsCapabilitiesAdminTestsJSON-432175994 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6883850097656, 'free_capacity_gb': 1775.6883850097656, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 17 03:42:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e7c09eae-da05-4de3-82fd-c326ad016054 tempest-BackendsCapabilitiesAdminTestsJSON-432175994 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6883850097656, 'free_capacity_gb': 1775.6883850097656, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 17 03:42:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0cfd3fb2-6c1d-43e1-97bb-9c69eafb8d5f tempest-GroupsTest-5032705 None] Update group completed successfully.
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Created reservations ['700bde2b-f9dc-4c33-beca-bb7e807b62e9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:17 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:17 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:17 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8901614f-456f-490d-88eb-81a82646d1db tempest-GroupsV320Test-613601063 None] Delete group completed successfully.
Jul 17 03:42:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4e6d86d3-edbb-40cc-9e26-d33ca2f3bc66 tempest-GroupsTest-5032705 None] Update group completed successfully.
Jul 17 03:42:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Acquiring lock "cinder-quobyte-89197df2-df85-420d-842e-44a4240ed842" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Lock "cinder-quobyte-89197df2-df85-420d-842e-44a4240ed842" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b5e11-677e-4ef7-bdf5-f3ac669a60ad]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:20 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842
Jul 17 03:42:20 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:20 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842" returned: 0 in 0.598s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:20 devstack sudo[90962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842
Jul 17 03:42:20 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:20 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-89197df2-df85-420d-842e-44a4240ed842" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Lock "cinder-quobyte-89197df2-df85-420d-842e-44a4240ed842" released by "delete_volume" :: held 0.981s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Acquiring lock "cinder-quobyte-a8dace02-453d-4a89-a9cb-5120e7f9b393" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Lock "cinder-quobyte-a8dace02-453d-4a89-a9cb-5120e7f9b393" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[816d1ce3-127b-452c-90e8-6c383564fdb6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:21 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393
Jul 17 03:42:21 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-26db957f-9940-4794-b53e-ba01ec87398d req-441b9659-c527-4e0a-bc01-94609a0978ad tempest-ServerActionsTestOtherA-1679357028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-26db957f-9940-4794-b53e-ba01ec87398d req-441b9659-c527-4e0a-bc01-94609a0978ad tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-26db957f-9940-4794-b53e-ba01ec87398d req-441b9659-c527-4e0a-bc01-94609a0978ad tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-26db957f-9940-4794-b53e-ba01ec87398d req-441b9659-c527-4e0a-bc01-94609a0978ad tempest-ServerActionsTestOtherA-1679357028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-103c80c5-4a85-462b-8f90-b942eb469137', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4c895e6-06bf-4ef9-96fb-a8305f84760f', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:42:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-26db957f-9940-4794-b53e-ba01ec87398d req-441b9659-c527-4e0a-bc01-94609a0978ad tempest-ServerActionsTestOtherA-1679357028 None] attachment_update completed successfully.
Jul 17 03:42:21 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393" returned: 0 in 0.576s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:21 devstack sudo[90980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393
Jul 17 03:42:21 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:21 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a8dace02-453d-4a89-a9cb-5120e7f9b393" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Lock "cinder-quobyte-a8dace02-453d-4a89-a9cb-5120e7f9b393" released by "delete_volume" :: held 0.992s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Created reservations ['ab25eddf-a008-4862-bcaf-8a0d8ce95bff'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:21 devstack cinder-volume[87498]: WARNING cinder.quota [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-595684880 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-595684880, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:21 devstack cinder-volume[87498]: WARNING cinder.quota [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-595684880 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-595684880, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Created reservations ['76f4870f-1e26-4566-b489-cce7b1ed41a1', '39c41700-fdde-4239-a481-de10e66a8b74', '2a5ed087-b452-401a-ac1f-cb965d9035ac', '0c859af7-32c6-4a5a-a699-7516755dc9e0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Created reservations ['cc3854ed-f7c6-4399-b342-1b686948432b', '207a5726-e023-4158-b73f-63eff0d55976', 'a46c06ca-9794-455b-8802-e6a252c8c0e9', '364c3307-028c-40ab-9957-0373f5cd8fae'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:22 devstack sudo[91366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:22 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:22 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5d23baea-2bd1-4bed-9a2f-ab2afb941fdf tempest-GroupsTest-5032705 None] Delete group completed successfully.
Jul 17 03:42:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f9978d6a-817a-44c2-bd63-e12524ce9e3a tempest-GroupSnapshotsTest-814293863 None] Group tempest-GroupSnapshotsTest-Group-1893115210: creating
Jul 17 03:42:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f9978d6a-817a-44c2-bd63-e12524ce9e3a tempest-GroupSnapshotsTest-814293863 None] Group tempest-GroupSnapshotsTest-Group-1893115210: created successfully
Jul 17 03:42:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f9978d6a-817a-44c2-bd63-e12524ce9e3a tempest-GroupSnapshotsTest-814293863 None] Create group completed successfully.
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (b55456a3-b3e6-40c9-81b7-4060f472629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c93ba5-5bc4-4b95-9a27-900076e9e2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c93ba5-5bc4-4b95-9a27-900076e9e2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515911255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2aff28a3-b86c-4904-8fe4-7f3f90edb5d4,host='devstack@QuobyteHD#QuobyteHD',id=542bf977-1745-4f5f-bf41-0c26d5050d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:25Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7170261-c9c1-42b1-94ad-6080e32bbcd5),volume_type_id=c7170261-c9c1-42b1-94ad-6080e32bbcd5)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3577546d-4039-4ec0-b4de-d19f7106b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3577546d-4039-4ec0-b4de-d19f7106b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5232d95c-1b21-42ac-b303-4359ca411f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5232d95c-1b21-42ac-b303-4359ca411f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542bf977-1745-4f5f-bf41-0c26d5050d47', 'volume_name': 'volume-542bf977-1745-4f5f-bf41-0c26d5050d47', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deea8761-8bcd-4251-b015-37c6b20eea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deea8761-8bcd-4251-b015-37c6b20eea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b50aef-fea1-404d-806e-89833c132bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Volume 542bf977-1745-4f5f-bf41-0c26d5050d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542bf977-1745-4f5f-bf41-0c26d5050d47', 'volume_size': 1}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2aff28a3-b86c-4904-8fe4-7f3f90edb5d4,created_at=2026-07-17T01:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1515911255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2aff28a3-b86c-4904-8fe4-7f3f90edb5d4,host='devstack@QuobyteHD#QuobyteHD',id=542bf977-1745-4f5f-bf41-0c26d5050d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:25Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7170261-c9c1-42b1-94ad-6080e32bbcd5),volume_type_id=c7170261-c9c1-42b1-94ad-6080e32bbcd5)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Creating volume 542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:24 devstack sudo[91372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 1073741824
Jul 17 03:42:24 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:25 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 1073741824" returned: 0 in 0.665s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:25 devstack sudo[91399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47
Jul 17 03:42:25 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-771d89d3-cf85-4e0c-96a8-5bd84568cb1f req-ef7b0f35-93e4-436b-95f5-242ebc02dde6 tempest-ServerActionsTestOtherA-1679357028 None] Terminate volume connection completed successfully.
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-771d89d3-cf85-4e0c-96a8-5bd84568cb1f req-ef7b0f35-93e4-436b-95f5-242ebc02dde6 tempest-ServerActionsTestOtherA-1679357028 None] Deleting attachment e4c895e6-06bf-4ef9-96fb-a8305f84760f. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:42:25 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b50aef-fea1-404d-806e-89833c132bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542bf977-1745-4f5f-bf41-0c26d5050d47', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87402e27-7e4d-457e-b651-7bc2129f00da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Volume volume-542bf977-1745-4f5f-bf41-0c26d5050d47 (542bf977-1745-4f5f-bf41-0c26d5050d47): created successfully
Jul 17 03:42:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87402e27-7e4d-457e-b651-7bc2129f00da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (b55456a3-b3e6-40c9-81b7-4060f472629d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3e74fdfc-d36e-4274-9d24-d14bb275d5a6 tempest-GroupSnapshotsTest-814293863 None] Created volume successfully.
Jul 17 03:42:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-771d89d3-cf85-4e0c-96a8-5bd84568cb1f req-a1454e71-175c-4c46-9598-873f42ae127e tempest-ServerActionsTestOtherA-1679357028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-771d89d3-cf85-4e0c-96a8-5bd84568cb1f req-a1454e71-175c-4c46-9598-873f42ae127e tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-771d89d3-cf85-4e0c-96a8-5bd84568cb1f req-a1454e71-175c-4c46-9598-873f42ae127e tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-771d89d3-cf85-4e0c-96a8-5bd84568cb1f req-a1454e71-175c-4c46-9598-873f42ae127e tempest-ServerActionsTestOtherA-1679357028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-103c80c5-4a85-462b-8f90-b942eb469137', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '105fc02b-a510-42a7-921e-e83a6cb82c9d', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:42:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-771d89d3-cf85-4e0c-96a8-5bd84568cb1f req-a1454e71-175c-4c46-9598-873f42ae127e tempest-ServerActionsTestOtherA-1679357028 None] attachment_update completed successfully.
Jul 17 03:42:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] GroupSnapshot 3bcca689-fa5d-4ac0-a06a-28f022532ef1: creating.
Jul 17 03:42:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Group snapshot 3bcca689-fa5d-4ac0-a06a-28f022532ef1: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 17 03:42:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Creating offline snapshot 84a61418-87e9-4ad4-884e-48a3b5149cff of volume 542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:42:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8050c0-07ab-47fe-8091-8389738ca6b3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:27 devstack sudo[91495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47
Jul 17 03:42:27 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:28 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:28 devstack sudo[91513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff 1G
Jul 17 03:42:28 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:29 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff 1G" returned: 0 in 0.744s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542bf977-1745-4f5f-bf41-0c26d5050d47 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:29 devstack sudo[91603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542bf977-1745-4f5f-bf41-0c26d5050d47 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff
Jul 17 03:42:29 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:29 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-542bf977-1745-4f5f-bf41-0c26d5050d47 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff" returned: 0 in 0.519s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:29 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:42:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:29 devstack sudo[91946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff
Jul 17 03:42:29 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:29 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:30 devstack sudo[91951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.info
Jul 17 03:42:30 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:30 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.info" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:30 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:42:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:30 devstack sudo[91955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.info
Jul 17 03:42:30 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:30 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.info" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.385s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-859fc9e6-11d1-44b3-9862-3a048e270b2f tempest-GroupSnapshotsTest-814293863 None] group_snapshot 3bcca689-fa5d-4ac0-a06a-28f022532ef1: created successfully
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Flow 'volume_create_manager' (7ebf8d7d-c26d-45d1-b950-b7bb523d9e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e9114e-ada2-4f16-9f45-d3f5476c579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e9114e-ada2-4f16-9f45-d3f5476c579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-658377316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54988e0d-d25e-4f53-a5bc-9b4950bb9f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6925950a6c04d0c915fd174840919d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:31Z,use_quota=True,user_id='6a356af92e1b4fe68409e305a5331b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f6c2c78-42a9-4a3b-b22c-c89b7cd19c08),volume_type_id=3f6c2c78-42a9-4a3b-b22c-c89b7cd19c08)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555a68de-852a-45b8-b89f-905589a9e588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555a68de-852a-45b8-b89f-905589a9e588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4947f277-294c-4a3a-8669-5793edd0e9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4947f277-294c-4a3a-8669-5793edd0e9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54988e0d-d25e-4f53-a5bc-9b4950bb9f1a', 'volume_name': 'volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2193222e-5b41-43de-b531-5b2a67cd60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2193222e-5b41-43de-b531-5b2a67cd60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1e0307-1596-49f3-9461-16cf27b1d672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Volume 54988e0d-d25e-4f53-a5bc-9b4950bb9f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a', 'volume_size': 1}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-658377316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54988e0d-d25e-4f53-a5bc-9b4950bb9f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6925950a6c04d0c915fd174840919d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:31Z,use_quota=True,user_id='6a356af92e1b4fe68409e305a5331b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f6c2c78-42a9-4a3b-b22c-c89b7cd19c08),volume_type_id=3f6c2c78-42a9-4a3b-b22c-c89b7cd19c08)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Creating volume 54988e0d-d25e-4f53-a5bc-9b4950bb9f1a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:31 devstack sudo[91962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a 1073741824
Jul 17 03:42:31 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:32 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a 1073741824" returned: 0 in 0.534s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:32 devstack sudo[91968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a
Jul 17 03:42:32 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:32 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1e0307-1596-49f3-9461-16cf27b1d672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1068dbee-776d-4343-a069-89cee1d85792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Volume volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a (54988e0d-d25e-4f53-a5bc-9b4950bb9f1a): created successfully
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1068dbee-776d-4343-a069-89cee1d85792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Flow 'volume_create_manager' (7ebf8d7d-c26d-45d1-b950-b7bb523d9e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5dc0b7b3-4ab5-43fa-aabb-9c645785f50a tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Created volume successfully.
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-84a61418-87e9-4ad4-884e-48a3b5149cff-8af4e453-d534-4730-82ff-91af82ded6e4" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-84a61418-87e9-4ad4-884e-48a3b5149cff-8af4e453-d534-4730-82ff-91af82ded6e4" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Creating volume 8af4e453-d534-4730-82ff-91af82ded6e4 from snapshot 84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-8af4e453-d534-4730-82ff-91af82ded6e4" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-8af4e453-d534-4730-82ff-91af82ded6e4" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] snapshot: 84a61418-87e9-4ad4-884e-48a3b5149cff, volume: 8af4e453-d534-4730-82ff-91af82ded6e4,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e38f437-b23b-48ec-8d89-e0282b5b4d9b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:33 devstack sudo[91971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff
Jul 17 03:42:33 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:33 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-542bf977-1745-4f5f-bf41-0c26d5050d47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fee586c-51b6-467a-868a-82942b6d31ee]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:33 devstack sudo[91976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47
Jul 17 03:42:33 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:33 devstack sudo[91978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:33 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:34 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:34 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:42:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:34 devstack sudo[91983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4
Jul 17 03:42:34 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:34 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-31172b11-e9dd-4170-9c36-c1eebd06abed tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Retype volume completed successfully.
Jul 17 03:42:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Acquiring lock "cinder-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "cinder-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Acquiring lock "cinder-quobyte-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "cinder-quobyte-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1d62c-2473-45ba-b732-14474cc16b3e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:37 devstack sudo[91999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a
Jul 17 03:42:37 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:38 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Flow 'volume_create_manager' (2b2280b8-dd3f-42a4-9ae4-e4f04f4bef05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b261db-e916-44a6-b379-67dc19b6472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a" returned: 0 in 1.521s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b261db-e916-44a6-b379-67dc19b6472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-185098878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4e4b22-c16e-448a-872c-32232428ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb51b89e984489b9644163388c24c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:38Z,use_quota=True,user_id='e3702ccb37114edcb7427e74a3c3c68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e32ce5-a5a3-42a5-8117-37a7be805069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e32ce5-a5a3-42a5-8117-37a7be805069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9339c94-23ed-4562-8cc6-c0dedc83e55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9339c94-23ed-4562-8cc6-c0dedc83e55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea4e4b22-c16e-448a-872c-32232428ed61', 'volume_name': 'volume-ea4e4b22-c16e-448a-872c-32232428ed61', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:38 devstack sudo[92004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a
Jul 17 03:42:38 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0938257-fb3d-4955-959c-ae14667e3dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0938257-fb3d-4955-959c-ae14667e3dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ebe58b-af01-4630-ac8f-a290e0bd9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Volume ea4e4b22-c16e-448a-872c-32232428ed61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea4e4b22-c16e-448a-872c-32232428ed61', 'volume_size': 1}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:38 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a" returned: 0 in 0.553s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "cinder-quobyte-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a" released by "delete_volume" :: held 2.214s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:38 devstack cinder-volume[87498]: WARNING cinder.quota [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:38 devstack cinder-volume[87498]: WARNING cinder.quota [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:38 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Created reservations ['6bcaef0a-ca00-4aa5-9455-933825846200', '866905d5-59c0-4719-8598-c56cb691cb97', 'a4d91f60-7536-4086-8349-3768074cabd9', '6914c54e-f6e8-4236-afbb-c7a84f979ac0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:39 devstack sudo[92007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:39 devstack sudo[92007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:39 devstack sudo[92007]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Deleted volume successfully.
Jul 17 03:42:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bb979d61-ba0c-4293-aec1-4d8ac826dc9d tempest-VolumeRetypeWithoutMigrationTest-739529257 None] Lock "cinder-54988e0d-d25e-4f53-a5bc-9b4950bb9f1a-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:40 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4" returned: 0 in 6.147s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbe3277-ed63-4ea5-992d-b866f9a9b5bc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:40 devstack sudo[92010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47
Jul 17 03:42:40 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:40 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47" returned: 0 in 0.605s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:40 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:42:40 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Converted 1024.00 MB image at 166.55 MB/s
Jul 17 03:42:40 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4 is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:42:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:40 devstack sudo[92015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4
Jul 17 03:42:40 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:41 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-8af4e453-d534-4730-82ff-91af82ded6e4" released by "_copy_volume_from_snapshot" :: held 8.213s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-84a61418-87e9-4ad4-884e-48a3b5149cff-8af4e453-d534-4730-82ff-91af82ded6e4" released by "_create_volume_from_snapshot" :: held 8.263s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.288s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.877s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-185098878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea4e4b22-c16e-448a-872c-32232428ed61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb51b89e984489b9644163388c24c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:38Z,use_quota=True,user_id='e3702ccb37114edcb7427e74a3c3c68c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Creating volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:41 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:41 devstack sudo[92018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 1073741824
Jul 17 03:42:41 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c2301093-32a4-40a1-a95b-9ceb7170075c tempest-GroupSnapshotsTest-814293863 None] Create group from source-snapshot-3bcca689-fa5d-4ac0-a06a-28f022532ef1 completed successfully.
Jul 17 03:42:41 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 1073741824" returned: 0 in 0.637s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:41 devstack sudo[92025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61
Jul 17 03:42:41 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-8af4e453-d534-4730-82ff-91af82ded6e4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-8af4e453-d534-4730-82ff-91af82ded6e4" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c550f8b-cb8b-4b8f-bbd0-af36ad88e37d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:42 devstack sudo[92027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4
Jul 17 03:42:42 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:42 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61" returned: 0 in 0.537s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ebe58b-af01-4630-ac8f-a290e0bd9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea4e4b22-c16e-448a-872c-32232428ed61', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4f28f7-8c21-4351-a68a-df2675807a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Volume volume-ea4e4b22-c16e-448a-872c-32232428ed61 (ea4e4b22-c16e-448a-872c-32232428ed61): created successfully
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4f28f7-8c21-4351-a68a-df2675807a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Flow 'volume_create_manager' (2b2280b8-dd3f-42a4-9ae4-e4f04f4bef05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a9a4b517-ed82-49f5-80ef-1c7ec2b42514 tempest-SnapshotsActionsTest-233783043 None] Created volume successfully.
Jul 17 03:42:42 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4" returned: 0 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:42 devstack sudo[92033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4
Jul 17 03:42:42 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:42 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af4e453-d534-4730-82ff-91af82ded6e4" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-8af4e453-d534-4730-82ff-91af82ded6e4" released by "delete_volume" :: held 0.844s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Created reservations ['8956e401-33f8-4c62-9ff5-d9ea6d4c99d8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:43 devstack cinder-volume[87498]: WARNING cinder.quota [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-467702768 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-467702768, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:43 devstack cinder-volume[87498]: WARNING cinder.quota [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-467702768 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-467702768, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Created reservations ['5fe6592e-3061-40b8-b5e0-8729f138f165', '8531e81f-d950-475f-92fb-4bc172364a18', '8e235e3f-ea3c-4306-b6d7-a9feab798c47', '384faba1-c2b2-4509-af24-4f66c6d4a1a2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:43 devstack sudo[92036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:43 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:43 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b28aecaf-656e-4cde-88fc-eedfff82eb84 tempest-GroupSnapshotsTest-814293863 None] Delete group completed successfully.
Jul 17 03:42:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] group_snapshot 3bcca689-fa5d-4ac0-a06a-28f022532ef1: deleting
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] group_snapshot 3bcca689-fa5d-4ac0-a06a-28f022532ef1: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-542bf977-1745-4f5f-bf41-0c26d5050d47" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-542bf977-1745-4f5f-bf41-0c26d5050d47" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-84a61418-87e9-4ad4-884e-48a3b5149cff" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-84a61418-87e9-4ad4-884e-48a3b5149cff" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Deleting offline snapshot 84a61418-87e9-4ad4-884e-48a3b5149cff of volume 542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] snapshot_file for this snap is: volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59aa4e0-74c2-4e60-b839-5eba003274c1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Creating offline snapshot b126db7d-a6f7-4533-818a-0a6945c2907d of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5194223e-8289-4819-85f4-db86ae34ebdd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:44 devstack sudo[92039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff
Jul 17 03:42:44 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:44 devstack sudo[92040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61
Jul 17 03:42:44 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:44 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-542bf977-1745-4f5f-bf41-0c26d5050d47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe707b5-5812-470c-b140-0bc42436df01]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:44 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:44 devstack sudo[92052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d 1G
Jul 17 03:42:44 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:44 devstack sudo[92047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47
Jul 17 03:42:44 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:44 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:44 devstack sudo[92061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff
Jul 17 03:42:44 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:45 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d 1G" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:45 devstack sudo[92065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:42:45 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:45 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:45 devstack sudo[92094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff
Jul 17 03:42:45 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:45 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:45 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d is being set with open permissions: ugo+rw
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:45 devstack sudo[92096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:42:45 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:45 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47.84a61418-87e9-4ad4-884e-48a3b5149cff" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:45 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-84a61418-87e9-4ad4-884e-48a3b5149cff" released by "_delete_snapshot" :: held 1.910s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-542bf977-1745-4f5f-bf41-0c26d5050d47" released by "delete_snapshot" :: held 1.971s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:45 devstack sudo[92100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.info
Jul 17 03:42:45 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:45 devstack cinder-volume[87498]: WARNING cinder.quota [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-467702768 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-467702768, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:42:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] Created reservations ['b0f6e7a1-52df-47bd-a57f-c75f05883b08', '64d67365-32a9-42d5-8890-2db6fb01fda9', '25fa5026-e112-4453-bbfd-57c35f024e3a', 'ddcb7f34-1f1f-4572-a9f3-8d4c7f69f5a2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-42896225-1059-4d69-b278-389745711172 tempest-GroupSnapshotsTest-814293863 None] group_snapshot 3bcca689-fa5d-4ac0-a06a-28f022532ef1: deleted successfully
Jul 17 03:42:46 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.info" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:46 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.info is being set with open permissions: ugo+rw
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:46 devstack sudo[92103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.info
Jul 17 03:42:46 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:46 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.info" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-542bf977-1745-4f5f-bf41-0c26d5050d47" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-542bf977-1745-4f5f-bf41-0c26d5050d47" acquired by "delete_volume" :: waited 0.083s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1d95b9c6-d04c-47b6-83ff-e07913b9f42d tempest-SnapshotsActionsTest-233783043 None] Create snapshot completed successfully
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cde6331-aeef-43e3-ae51-974a57e2f84c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:46 devstack sudo[92106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47
Jul 17 03:42:46 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:46 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:46 devstack sudo[92111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47
Jul 17 03:42:46 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Flow 'volume_create_manager' (4af288cb-4766-49e5-9dd2-edfc1bf4db92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cb7df0-d8e1-437f-981c-78f0b71a2888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cb7df0-d8e1-437f-981c-78f0b71a2888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1136919864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e990690-beeb-46a4-b20d-5d3e3461827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ffa717a96a4e5bb037a3015f107eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:47Z,use_quota=True,user_id='0cde22a0864c42fa9487113c7f19d633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3be942e-a713-4d0a-bdf6-5b4b577296b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3be942e-a713-4d0a-bdf6-5b4b577296b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a196298-6300-45bc-9f1d-026a21d79250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a196298-6300-45bc-9f1d-026a21d79250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e990690-beeb-46a4-b20d-5d3e3461827a', 'volume_name': 'volume-2e990690-beeb-46a4-b20d-5d3e3461827a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc18762-28a5-45ac-a92c-26ef0b02bb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc18762-28a5-45ac-a92c-26ef0b02bb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39e3f52-d656-4b41-9442-9467889ad04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Volume 2e990690-beeb-46a4-b20d-5d3e3461827a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e990690-beeb-46a4-b20d-5d3e3461827a', 'volume_size': 1}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1136919864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e990690-beeb-46a4-b20d-5d3e3461827a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ffa717a96a4e5bb037a3015f107eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:47Z,use_quota=True,user_id='0cde22a0864c42fa9487113c7f19d633',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Creating volume 2e990690-beeb-46a4-b20d-5d3e3461827a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:47 devstack sudo[92113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a 1073741824
Jul 17 03:42:47 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:47 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-542bf977-1745-4f5f-bf41-0c26d5050d47" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-542bf977-1745-4f5f-bf41-0c26d5050d47" released by "delete_volume" :: held 0.717s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Created reservations ['b07f4f9c-5c78-4601-b2cd-a663cdedb58b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:47 devstack cinder-volume[87498]: WARNING cinder.db.api [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-467702768']
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Created reservations ['197eb9a3-9b27-4865-8521-3227a5d6a26c', '2b0b4c63-afb6-4fe1-b744-7929d6352f2f', '8e985e28-16fc-42c8-ba24-8325dd32b66a', '198d2eaa-cfb2-4e2a-9023-edcaf626740c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:47 devstack sudo[92126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:47 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:47 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a 1073741824" returned: 0 in 0.554s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:47 devstack sudo[92128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a
Jul 17 03:42:47 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:47 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7184820b-f053-4485-b557-25da25d1e1ec tempest-GroupSnapshotsTest-814293863 None] Delete group completed successfully.
Jul 17 03:42:47 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.160s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39e3f52-d656-4b41-9442-9467889ad04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e990690-beeb-46a4-b20d-5d3e3461827a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9da69f-5694-40e9-9139-5da140e32808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Creating offline snapshot 436b0119-d3e9-4e30-b2d9-fc75e56dddb9 of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:42:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Volume volume-2e990690-beeb-46a4-b20d-5d3e3461827a (2e990690-beeb-46a4-b20d-5d3e3461827a): created successfully
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9da69f-5694-40e9-9139-5da140e32808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Flow 'volume_create_manager' (4af288cb-4766-49e5-9dd2-edfc1bf4db92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eff80e6-ef80-40f2-afc5-bd2641f11300]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-12663b92-43c0-44a5-b680-cccede65a570 tempest-GroupSnapshotsTest-814293863 None] Group tempest-GroupSnapshotsTest-Group-94327091: creating
Jul 17 03:42:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2adeaaf7-fc8d-4af1-8ffa-4b2538ab3dfd tempest-VolumesServicesTestJSON-427961092 None] Created volume successfully.
Jul 17 03:42:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-12663b92-43c0-44a5-b680-cccede65a570 tempest-GroupSnapshotsTest-814293863 None] Group tempest-GroupSnapshotsTest-Group-94327091: created successfully
Jul 17 03:42:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-12663b92-43c0-44a5-b680-cccede65a570 tempest-GroupSnapshotsTest-814293863 None] Create group completed successfully.
Jul 17 03:42:48 devstack sudo[92132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:42:48 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:48 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:48 devstack sudo[92137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 1G
Jul 17 03:42:48 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:48 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 1G" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:48 devstack sudo[92167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9
Jul 17 03:42:48 devstack sudo[92167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:49 devstack sudo[92167]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:49 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 is being set with open permissions: ugo+rw
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Acquiring lock "cinder-2e990690-beeb-46a4-b20d-5d3e3461827a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:49 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9
Jul 17 03:42:49 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Lock "cinder-2e990690-beeb-46a4-b20d-5d3e3461827a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Acquiring lock "cinder-quobyte-2e990690-beeb-46a4-b20d-5d3e3461827a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Lock "cinder-quobyte-2e990690-beeb-46a4-b20d-5d3e3461827a" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3834410-6cc9-4df0-867e-6937471d7c15]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:49 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:49 devstack sudo[92174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a
Jul 17 03:42:49 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.547s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-da38918f-fb4d-4b61-9d5a-ad26e2e2a77d tempest-SnapshotsActionsTest-233783043 None] Create snapshot completed successfully
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (e0d42bc0-67e4-44b8-bf9d-fbfc58ac1067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afea307-ed3d-4e8b-99c7-d47f365e8ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:49 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7afea307-ed3d-4e8b-99c7-d47f365e8ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750328903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8baafd1-82af-4c6c-b058-5a7e562bd3ad,host='devstack@QuobyteHD#QuobyteHD',id=fb164583-c720-4b57-84e4-532b1feffcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:50Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1e5ca24-6f29-486d-9780-c015ed5d6e74),volume_type_id=a1e5ca24-6f29-486d-9780-c015ed5d6e74)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e08254d-f86b-4df2-8d98-83dd687ffbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e08254d-f86b-4df2-8d98-83dd687ffbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b927fcff-9e03-4f4b-9fdc-88a17818dd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b927fcff-9e03-4f4b-9fdc-88a17818dd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb164583-c720-4b57-84e4-532b1feffcb4', 'volume_name': 'volume-fb164583-c720-4b57-84e4-532b1feffcb4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3217a13-e8d2-4cc0-8c6c-b80e2c7d3877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3217a13-e8d2-4cc0-8c6c-b80e2c7d3877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13ee6d4-33f9-4536-a177-95a9a87a49db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Volume fb164583-c720-4b57-84e4-532b1feffcb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb164583-c720-4b57-84e4-532b1feffcb4', 'volume_size': 1}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c8baafd1-82af-4c6c-b058-5a7e562bd3ad,created_at=2026-07-17T01:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750328903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8baafd1-82af-4c6c-b058-5a7e562bd3ad,host='devstack@QuobyteHD#QuobyteHD',id=fb164583-c720-4b57-84e4-532b1feffcb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:50Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1e5ca24-6f29-486d-9780-c015ed5d6e74),volume_type_id=a1e5ca24-6f29-486d-9780-c015ed5d6e74)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Creating volume fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a" returned: 0 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:49 devstack sudo[92180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 1073741824
Jul 17 03:42:49 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:49 devstack sudo[92181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a
Jul 17 03:42:49 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-436b0119-d3e9-4e30-b2d9-fc75e56dddb9-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-436b0119-d3e9-4e30-b2d9-fc75e56dddb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-436b0119-d3e9-4e30-b2d9-fc75e56dddb9" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-436b0119-d3e9-4e30-b2d9-fc75e56dddb9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Deleting offline snapshot 436b0119-d3e9-4e30-b2d9-fc75e56dddb9 of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] snapshot_file for this snap is: volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a350831d-e1b9-41e5-9206-19855e820df8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:50 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2e990690-beeb-46a4-b20d-5d3e3461827a" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Lock "cinder-quobyte-2e990690-beeb-46a4-b20d-5d3e3461827a" released by "delete_volume" :: held 0.815s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Created reservations ['30d6cd01-639d-42ca-9eaf-60d3146fb2ba', '21734e82-207c-4df5-9980-60cb2817251c', '44519063-8df9-4810-a76b-e0a3884ad34b', '6a479a1e-f033-400b-babc-6b71d5305eeb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:50 devstack sudo[92188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9
Jul 17 03:42:50 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:50 devstack sudo[92191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:42:50 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:50 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 1073741824" returned: 0 in 0.515s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:50 devstack sudo[92193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4
Jul 17 03:42:50 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:50 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:42:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Deleted volume successfully.
Jul 17 03:42:50 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-923fa1a9-a602-485e-b689-34a6ff5f814b tempest-VolumesServicesTestJSON-427961092 None] Lock "cinder-2e990690-beeb-46a4-b20d-5d3e3461827a-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9" returned: 0 in 0.502s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db2923e-7686-46ba-aa20-787e22e83e89]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:50 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13ee6d4-33f9-4536-a177-95a9a87a49db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb164583-c720-4b57-84e4-532b1feffcb4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafb7ec2-dc83-487e-ae7a-9533caf6ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Volume volume-fb164583-c720-4b57-84e4-532b1feffcb4 (fb164583-c720-4b57-84e4-532b1feffcb4): created successfully
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bafb7ec2-dc83-487e-ae7a-9533caf6ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (e0d42bc0-67e4-44b8-bf9d-fbfc58ac1067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:50 devstack sudo[92200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:42:50 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c58f9990-e012-4526-8678-b24991667a1f tempest-GroupSnapshotsTest-814293863 None] Created volume successfully.
Jul 17 03:42:51 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:51 devstack sudo[92207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9
Jul 17 03:42:51 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:51 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:51 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9
Jul 17 03:42:51 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (3e5e89a9-e9e4-4df9-b7bc-69338033377a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8d8e19-bb3f-4bd5-9839-aae46a830f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e8d8e19-bb3f-4bd5-9839-aae46a830f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-765226764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8baafd1-82af-4c6c-b058-5a7e562bd3ad,host='devstack@QuobyteHD#QuobyteHD',id=800b8a76-52d8-48a5-accb-d187deb7c7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:51Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1e5ca24-6f29-486d-9780-c015ed5d6e74),volume_type_id=a1e5ca24-6f29-486d-9780-c015ed5d6e74)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548b5642-ca7e-46f8-8387-aeca70605fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548b5642-ca7e-46f8-8387-aeca70605fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258e98f9-bc6f-4a37-a620-be26ad25d1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258e98f9-bc6f-4a37-a620-be26ad25d1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800b8a76-52d8-48a5-accb-d187deb7c7c9', 'volume_name': 'volume-800b8a76-52d8-48a5-accb-d187deb7c7c9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8304057a-0700-4636-92fb-47ed9461aaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8304057a-0700-4636-92fb-47ed9461aaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be83cdca-eb7d-4d63-b0e7-b3288c664cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Volume 800b8a76-52d8-48a5-accb-d187deb7c7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800b8a76-52d8-48a5-accb-d187deb7c7c9', 'volume_size': 1}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c8baafd1-82af-4c6c-b058-5a7e562bd3ad,created_at=2026-07-17T01:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-765226764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c8baafd1-82af-4c6c-b058-5a7e562bd3ad,host='devstack@QuobyteHD#QuobyteHD',id=800b8a76-52d8-48a5-accb-d187deb7c7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:42:51Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1e5ca24-6f29-486d-9780-c015ed5d6e74),volume_type_id=a1e5ca24-6f29-486d-9780-c015ed5d6e74)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Creating volume 800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:42:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:51 devstack sudo[92214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 1073741824
Jul 17 03:42:51 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:51 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.436b0119-d3e9-4e30-b2d9-fc75e56dddb9" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-436b0119-d3e9-4e30-b2d9-fc75e56dddb9" released by "_delete_snapshot" :: held 1.794s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" released by "delete_snapshot" :: held 1.817s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Created reservations ['cb744971-e02b-40e5-9cd3-d66ee886ffea', 'a74e9e30-363a-487d-99b4-6bcb85cb0699', '570000b9-3e31-4259-9ad9-461cc61893f9', 'f2188c78-6176-4d12-ae54-4d765a22821d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Delete snapshot completed successfully.
Jul 17 03:42:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-158dd44c-a4c8-4de7-8df6-2d3f26f682a5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-436b0119-d3e9-4e30-b2d9-fc75e56dddb9-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:52 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 1073741824" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:52 devstack sudo[92221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9
Jul 17 03:42:52 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:52 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.110s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be83cdca-eb7d-4d63-b0e7-b3288c664cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800b8a76-52d8-48a5-accb-d187deb7c7c9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fdc3d8-58e6-4735-bba3-640e4be5ff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Creating offline snapshot d0c452a9-67a0-4766-854c-bd3362bae8dd of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:42:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Volume volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 (800b8a76-52d8-48a5-accb-d187deb7c7c9): created successfully
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fdc3d8-58e6-4735-bba3-640e4be5ff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (3e5e89a9-e9e4-4df9-b7bc-69338033377a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08c761-48ad-4bef-b564-1b96c2b82f82]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d8cab66d-23d3-4b85-bcfd-27549ca2be77 tempest-GroupSnapshotsTest-814293863 None] Created volume successfully.
Jul 17 03:42:52 devstack sudo[92224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:42:52 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:53 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.459s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:53 devstack sudo[92229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd 1G
Jul 17 03:42:53 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:53 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd 1G" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:53 devstack sudo[92234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd
Jul 17 03:42:53 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:54 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd is being set with open permissions: ugo+rw
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:54 devstack sudo[92239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd
Jul 17 03:42:54 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:INSERT=34,cinder:SELECT=163,cinder:UPDATE=170,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=170,cinder:INSERT=35,cinder:UPDATE=160,cinder:DELETE=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:42:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8f6817d2-e8c0-41d8-801c-dc708d51750e tempest-GroupSnapshotsTest-814293863 None] Update group completed successfully.
Jul 17 03:42:54 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d85455e5-88d3-4004-ba26-0a0877db31c7 tempest-SnapshotsActionsTest-233783043 None] Create snapshot completed successfully
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-d0c452a9-67a0-4766-854c-bd3362bae8dd-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-d0c452a9-67a0-4766-854c-bd3362bae8dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-d0c452a9-67a0-4766-854c-bd3362bae8dd" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-d0c452a9-67a0-4766-854c-bd3362bae8dd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Deleting offline snapshot d0c452a9-67a0-4766-854c-bd3362bae8dd of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] snapshot_file for this snap is: volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b34ae05-71d4-4644-9fb1-c1a109613fb2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:54 devstack sudo[92242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd
Jul 17 03:42:54 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:55 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[085304f9-c7c1-4e3b-85ac-c6e11898df5c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:55 devstack sudo[92247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:42:55 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-139a5649-6a80-4da3-a260-d252d8b432f6 tempest-GroupSnapshotsTest-814293863 None] Update group completed successfully.
Jul 17 03:42:55 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:55 devstack sudo[92255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd
Jul 17 03:42:55 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:56 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:56 devstack sudo[92261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd
Jul 17 03:42:56 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:56 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.d0c452a9-67a0-4766-854c-bd3362bae8dd" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-d0c452a9-67a0-4766-854c-bd3362bae8dd" released by "_delete_snapshot" :: held 1.775s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" released by "delete_snapshot" :: held 1.814s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d8763651-e567-4af4-975c-23c1c2ae35f5 tempest-GroupSnapshotsTest-814293863 None] Update group completed successfully.
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Created reservations ['45a27cd6-76e1-47ef-bbab-023cb93e2840', '826a7896-8811-4c85-b31c-8d11ee622de2', '9b2ebf3d-9582-4e43-a04b-79cff2f1c0ff', '5184e03f-7f97-43a9-b028-df4f2eb56f80'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:42:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-eb087c64-c7e5-4760-9326-0b1d8444a36a req-02e3b89a-9e44-460a-b788-15c676f2b8d1 tempest-ServerActionsTestOtherA-1679357028 None] Terminate volume connection completed successfully.
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-eb087c64-c7e5-4760-9326-0b1d8444a36a req-02e3b89a-9e44-460a-b788-15c676f2b8d1 tempest-ServerActionsTestOtherA-1679357028 None] Deleting attachment 105fc02b-a510-42a7-921e-e83a6cb82c9d. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:42:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Delete snapshot completed successfully.
Jul 17 03:42:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0aa0e46-dd85-46bd-8db0-d0b9d45e898f tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-d0c452a9-67a0-4766-854c-bd3362bae8dd-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Creating offline snapshot 85bb0bd7-bcdd-478d-b862-4e10b0325ab2 of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa53809-6268-4773-85dc-572d4a065759]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:57 devstack sudo[92268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:42:57 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:57 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:42:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:57 devstack sudo[92274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 1G
Jul 17 03:42:57 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-05959442-b975-48c7-a78f-72275a007829 tempest-GroupSnapshotsTest-814293863 None] Update group completed successfully.
Jul 17 03:42:58 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 1G" returned: 0 in 0.763s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:58 devstack sudo[92301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2
Jul 17 03:42:58 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:58 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:58 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 is being set with open permissions: ugo+rw
Jul 17 03:42:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:58 devstack sudo[92309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2
Jul 17 03:42:58 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:42:59 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:42:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bc98f958-0b48-4aeb-aad8-a99fd32d8458 tempest-SnapshotsActionsTest-233783043 None] Create snapshot completed successfully
Jul 17 03:42:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] GroupSnapshot 5ce6553c-362d-4e7b-9fe8-347d3aa67cf5: creating.
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Group snapshot 5ce6553c-362d-4e7b-9fe8-347d3aa67cf5: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Creating offline snapshot 10f13f83-9470-4b01-8b29-cb38bc1f285a of volume fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[984a86ad-a993-4b65-bf86-27e9bcce3075]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:42:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:42:59 devstack sudo[92314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4
Jul 17 03:42:59 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:00 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:00 devstack sudo[92319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a 1G
Jul 17 03:43:00 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-85bb0bd7-bcdd-478d-b862-4e10b0325ab2-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-85bb0bd7-bcdd-478d-b862-4e10b0325ab2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-85bb0bd7-bcdd-478d-b862-4e10b0325ab2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-85bb0bd7-bcdd-478d-b862-4e10b0325ab2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Deleting offline snapshot 85bb0bd7-bcdd-478d-b862-4e10b0325ab2 of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:43:00 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] snapshot_file for this snap is: volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a 1G" returned: 0 in 0.620s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb164583-c720-4b57-84e4-532b1feffcb4 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35640460-7574-481e-b5d1-444ef73b3f6a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:00 devstack sudo[92327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb164583-c720-4b57-84e4-532b1feffcb4 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a
Jul 17 03:43:00 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:00 devstack sudo[92328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2
Jul 17 03:43:00 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:01 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb164583-c720-4b57-84e4-532b1feffcb4 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:01 devstack sudo[92338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a
Jul 17 03:43:01 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:01 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26374bd-80f5-4847-9f33-ca98e46293f6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:01 devstack sudo[92340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:43:01 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:01 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:01 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.info
Jul 17 03:43:01 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:01 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.455s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:01 devstack sudo[92348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2
Jul 17 03:43:01 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:01 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.info" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:43:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:01 devstack sudo[92351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.info
Jul 17 03:43:01 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:02 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.info" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:02 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Creating offline snapshot f5530b38-306b-4051-9a96-7c820351bbec of volume 800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:43:02 devstack sudo[92358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2
Jul 17 03:43:02 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[772f2b61-fc90-46bd-a24e-f2d6ec34905b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:02 devstack sudo[92360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9
Jul 17 03:43:02 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Acquiring lock "cinder-103c80c5-4a85-462b-8f90-b942eb469137-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:02 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Lock "cinder-103c80c5-4a85-462b-8f90-b942eb469137-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.85bb0bd7-bcdd-478d-b862-4e10b0325ab2" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-85bb0bd7-bcdd-478d-b862-4e10b0325ab2" released by "_delete_snapshot" :: held 1.875s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" released by "delete_snapshot" :: held 1.910s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Acquiring lock "cinder-quobyte-103c80c5-4a85-462b-8f90-b942eb469137" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Lock "cinder-quobyte-103c80c5-4a85-462b-8f90-b942eb469137" acquired by "delete_volume" :: waited 0.058s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda400a9-9b2a-471f-a86e-be6b1e4e42c3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Created reservations ['07d76d92-24ff-4f25-afdc-0be42bc3ae9f', '32aec7ae-cea5-45dc-9318-0f0111dd05e5', '5308cf99-275d-42b6-be5d-e174c8755b71', 'e6018277-abdb-4ca9-948a-65076c9c0698'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Delete snapshot completed successfully.
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1dfadb93-9e03-4225-9111-a36860c63ba5 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-85bb0bd7-bcdd-478d-b862-4e10b0325ab2-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:02 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9" returned: 0 in 0.651s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:02 devstack sudo[92364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137
Jul 17 03:43:02 devstack sudo[92364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:02 devstack sudo[92367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec 1G
Jul 17 03:43:02 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:03 devstack sudo[92364]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:03 devstack sudo[92376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137
Jul 17 03:43:03 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:03 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec 1G" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:03 devstack sudo[92379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec
Jul 17 03:43:03 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:03 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-103c80c5-4a85-462b-8f90-b942eb469137" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Lock "cinder-quobyte-103c80c5-4a85-462b-8f90-b942eb469137" released by "delete_volume" :: held 0.820s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Created reservations ['9cdb7325-8a79-443b-935e-6cb288a82d46', '6a228d3a-c5ac-430a-b6ec-30ed073bd992', 'fcdf8177-9201-459a-836f-7b8214866108', '52ba3bc7-08ae-488e-83e1-1bc773793aed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:03 devstack sudo[92385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:03 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:03 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:03 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:43:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:03 devstack sudo[92387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec
Jul 17 03:43:03 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:04 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Deleted volume successfully.
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0123c100-8069-4c5e-8706-1ec27e76e58b tempest-ServerActionsTestOtherA-1679357028 None] Lock "cinder-103c80c5-4a85-462b-8f90-b942eb469137-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:04 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec" returned: 0 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:04 devstack sudo[92391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.info
Jul 17 03:43:04 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:04 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.info" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:04 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:04 devstack sudo[92394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.info
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:04 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:04 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.info" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.251s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Creating offline snapshot 8075d49c-85ca-41a5-8c44-ba0b708efe5d of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f227ed2-5bf3-4e4b-85ba-087713debd7c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7d68712c-8540-4686-85e4-89867d7a261c tempest-GroupSnapshotsTest-814293863 None] group_snapshot 5ce6553c-362d-4e7b-9fe8-347d3aa67cf5: created successfully
Jul 17 03:43:04 devstack sudo[92399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:43:04 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] group_snapshot 5ce6553c-362d-4e7b-9fe8-347d3aa67cf5: deleting
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] group_snapshot 5ce6553c-362d-4e7b-9fe8-347d3aa67cf5: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-fb164583-c720-4b57-84e4-532b1feffcb4" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:05 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-fb164583-c720-4b57-84e4-532b1feffcb4" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-10f13f83-9470-4b01-8b29-cb38bc1f285a" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.780s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:05 devstack sudo[92423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d 1G
Jul 17 03:43:05 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-10f13f83-9470-4b01-8b29-cb38bc1f285a" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Deleting offline snapshot 10f13f83-9470-4b01-8b29-cb38bc1f285a of volume fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] snapshot_file for this snap is: volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ffd8e-ec53-4c7e-adfc-fb8b92935158]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:05 devstack sudo[92429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a
Jul 17 03:43:05 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:06 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d 1G" returned: 0 in 0.634s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:06 devstack sudo[92439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d
Jul 17 03:43:06 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:06 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a" returned: 0 in 0.618s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb164583-c720-4b57-84e4-532b1feffcb4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d8ad8e-b485-4f9b-b5ff-8c82200d75f1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:06 devstack sudo[92443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4
Jul 17 03:43:06 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Flow 'volume_create_manager' (49eda6ce-0201-4933-b545-a612ed30f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a312617-f396-4bf4-be9e-d68506ed5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a312617-f396-4bf4-be9e-d68506ed5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1281766001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd055d46-2b86-4e38-a657-253e3cb5bb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d830eb545f0d46d89f48ca18c95130cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:06Z,use_quota=True,user_id='5eeca48d545c47e9bb502c59f4a48a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f00e6f9-85e4-44d2-a0ed-857eea4a4ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f00e6f9-85e4-44d2-a0ed-857eea4a4ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a200b6ee-fc31-4d5b-b301-6db80b30b883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 03:43:06 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d" returned: 0 in 0.443s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:06 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d is being set with open permissions: ugo+rw
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:06 devstack sudo[92449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d
Jul 17 03:43:06 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:06 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:06 devstack sudo[92454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a
Jul 17 03:43:06 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:07 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1650d592-8c64-4637-adca-1c22f2198cea tempest-SnapshotsActionsTest-233783043 None] Create snapshot completed successfully
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a200b6ee-fc31-4d5b-b301-6db80b30b883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd055d46-2b86-4e38-a657-253e3cb5bb76', 'volume_name': 'volume-fd055d46-2b86-4e38-a657-253e3cb5bb76', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ccb6e10>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8d6eac-6873-4e94-b3c3-45b53379f649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8d6eac-6873-4e94-b3c3-45b53379f649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3b8cef-610f-4973-8d5f-ec203df2b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Volume fd055d46-2b86-4e38-a657-253e3cb5bb76: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd055d46-2b86-4e38-a657-253e3cb5bb76', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ccb6e10>}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Trying to clone fd055d46-2b86-4e38-a657-253e3cb5bb76 from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 at location (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 03:43:07 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:07 devstack sudo[92461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a
Jul 17 03:43:07 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 03:43:07 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Image download 20.69 MB at 20.69 MB/s
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[657c7890-5522-438a-a8f3-a0e737bb1854]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:07 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4.10f13f83-9470-4b01-8b29-cb38bc1f285a" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-10f13f83-9470-4b01-8b29-cb38bc1f285a" released by "_delete_snapshot" :: held 2.081s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-fb164583-c720-4b57-84e4-532b1feffcb4" released by "delete_snapshot" :: held 2.149s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-800b8a76-52d8-48a5-accb-d187deb7c7c9" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-800b8a76-52d8-48a5-accb-d187deb7c7c9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-f5530b38-306b-4051-9a96-7c820351bbec" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:07 devstack sudo[92486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD
Jul 17 03:43:07 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-f5530b38-306b-4051-9a96-7c820351bbec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Deleting offline snapshot f5530b38-306b-4051-9a96-7c820351bbec of volume 800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] snapshot_file for this snap is: volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c0b824-5d4a-4c83-9cc5-c252e9a0bd9b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:07 devstack sudo[92488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec
Jul 17 03:43:07 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:08 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 is fetched for user 5eeca48d545c47e9bb502c59f4a48a46. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[689bb885-85a4-4937-a491-4b7016ac00e3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:08 devstack sudo[92494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD
Jul 17 03:43:08 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-8075d49c-85ca-41a5-8c44-ba0b708efe5d-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-8075d49c-85ca-41a5-8c44-ba0b708efe5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Acquiring lock "cinder-quobyte-8075d49c-85ca-41a5-8c44-ba0b708efe5d" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-8075d49c-85ca-41a5-8c44-ba0b708efe5d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Deleting offline snapshot 8075d49c-85ca-41a5-8c44-ba0b708efe5d of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:43:08 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] snapshot_file for this snap is: volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec" returned: 0 in 0.545s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800b8a76-52d8-48a5-accb-d187deb7c7c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03a6cae-ab38-46b2-93ad-12145f5d8153]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cc3034-3a3f-40b3-9692-3bfb1bf30921]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:08 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1281766001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd055d46-2b86-4e38-a657-253e3cb5bb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d830eb545f0d46d89f48ca18c95130cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:06Z,use_quota=True,user_id='5eeca48d545c47e9bb502c59f4a48a46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Creating volume fd055d46-2b86-4e38-a657-253e3cb5bb76 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:08 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:08 devstack sudo[92499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d
Jul 17 03:43:08 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:08 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9
Jul 17 03:43:08 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:08 devstack sudo[92505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 1073741824
Jul 17 03:43:08 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:08 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:08 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:08 devstack sudo[92518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec
Jul 17 03:43:08 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e6a97c-9ad2-4f16-b102-dbe6731375f9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:08 devstack sudo[92521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:43:08 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:08 devstack sudo[92521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 1073741824" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:09 devstack sudo[92523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76
Jul 17 03:43:09 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:09 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:09 devstack sudo[92528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec
Jul 17 03:43:09 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:09 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:09 devstack sudo[92521]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:09 devstack sudo[92534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d
Jul 17 03:43:09 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Attempting download of 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume fd055d46-2b86-4e38-a657-253e3cb5bb76. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b94e8-768e-4436-8477-b6b3a9528d2a]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_gj0jxosf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:09 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9.f5530b38-306b-4051-9a96-7c820351bbec" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-f5530b38-306b-4051-9a96-7c820351bbec" released by "_delete_snapshot" :: held 1.678s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-800b8a76-52d8-48a5-accb-d187deb7c7c9" released by "delete_snapshot" :: held 1.706s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:09 devstack sudo[92537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_gj0jxosf
Jul 17 03:43:09 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:09 devstack cinder-volume[87498]: WARNING cinder.quota [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-70557272 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-70557272, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:43:09 devstack cinder-volume[87498]: WARNING cinder.quota [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-70557272 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-70557272, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Created reservations ['066c5522-73f8-4c3e-b082-fcfe41bd97c6', '9e388b3f-bfb9-45f6-948f-09c8a802cfc0', '14e01a41-198b-4012-aba6-45b602abe70c', 'f94e8710-88f1-4950-b8df-10a9c0b36769'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] Created reservations ['98e69282-08b2-4b8d-bc3a-8aab17c761b4', '5c70325e-4a1e-42b4-a44a-e8ef09e09f7b', '14f83efd-199d-47e6-a4f3-0dc0836b775d', '33584deb-16b6-4ffa-977b-e13c33408ff0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:09 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d" returned: 0 in 0.542s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:09 devstack sudo[92543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d
Jul 17 03:43:09 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d668cf27-cc3a-4460-ad67-389aca2943e6 tempest-GroupSnapshotsTest-814293863 None] group_snapshot 5ce6553c-362d-4e7b-9fe8-347d3aa67cf5: deleted successfully
Jul 17 03:43:09 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_gj0jxosf" returned: 0 in 0.488s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_gj0jxosf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:09 devstack sudo[92547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_gj0jxosf
Jul 17 03:43:09 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:10 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.8075d49c-85ca-41a5-8c44-ba0b708efe5d" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-8075d49c-85ca-41a5-8c44-ba0b708efe5d" released by "_delete_snapshot" :: held 1.737s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" released by "delete_snapshot" :: held 1.763s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Created reservations ['9812c113-e542-47d8-87bb-5f45c6164fc0', '57042483-11f6-4ab8-9e84-e3eac3e05471', '58002f79-95db-43b6-be15-00cd6f9fecc4', '42e2f5e5-d61f-48fe-82c3-3e255f619eac'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:10 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Delete snapshot completed successfully.
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_gj0jxosf" returned: 1 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_gj0jxosf' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[81283729-bc46-415c-a75a-e0f36961b3b2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ba355f6-becc-437f-b2d6-a59a319fbd08 tempest-SnapshotsActionsTest-1725072276 None] Lock "cinder-8075d49c-85ca-41a5-8c44-ba0b708efe5d-delete_snapshot" released by "delete_snapshot" :: held 1.938s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:10 devstack sudo[92552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD
Jul 17 03:43:10 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:10 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:10 devstack sudo[92558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76
Jul 17 03:43:10 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-800b8a76-52d8-48a5-accb-d187deb7c7c9" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-800b8a76-52d8-48a5-accb-d187deb7c7c9" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20401f8d-e116-4ef6-a13b-9a9e0a905974]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "cinder-b126db7d-a6f7-4533-818a-0a6945c2907d-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-b126db7d-a6f7-4533-818a-0a6945c2907d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "cinder-quobyte-b126db7d-a6f7-4533-818a-0a6945c2907d" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-quobyte-b126db7d-a6f7-4533-818a-0a6945c2907d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Deleting offline snapshot b126db7d-a6f7-4533-818a-0a6945c2907d of volume ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] snapshot_file for this snap is: volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e24f9d-494a-497b-bd9a-42b9f7b2893d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:11 devstack sudo[92560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9
Jul 17 03:43:11 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:11 devstack sudo[92564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:43:11 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:11 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:11 devstack sudo[92574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9
Jul 17 03:43:11 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:11 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.452s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea4e4b22-c16e-448a-872c-32232428ed61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[92688f17-47a9-4c6e-a817-c4112dbc26c6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:11 devstack sudo[92579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61
Jul 17 03:43:11 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:11 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-800b8a76-52d8-48a5-accb-d187deb7c7c9" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-800b8a76-52d8-48a5-accb-d187deb7c7c9" released by "delete_volume" :: held 1.033s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-fb164583-c720-4b57-84e4-532b1feffcb4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-fb164583-c720-4b57-84e4-532b1feffcb4" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8772bc-e46a-484c-abe5-8d7437efc468]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:12 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61" returned: 0 in 0.502s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:12 devstack sudo[92588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:43:12 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:12 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4
Jul 17 03:43:12 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:12 devstack sudo[92591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:12 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:12 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:12 devstack sudo[92599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4
Jul 17 03:43:12 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:12 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:43:12 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:12 devstack sudo[92602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d
Jul 17 03:43:12 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:12 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fb164583-c720-4b57-84e4-532b1feffcb4" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-fb164583-c720-4b57-84e4-532b1feffcb4" released by "delete_volume" :: held 0.942s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Created reservations ['d77db587-9969-42d6-a35e-d00acce63363'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:12 devstack cinder-volume[87498]: WARNING cinder.quota [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-70557272 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-70557272, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:43:12 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:12 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76" returned: 0 in 2.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_m6kjaeyqdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:43:12 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Converted 112.00 MB image at 48.13 MB/s
Jul 17 03:43:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61.b126db7d-a6f7-4533-818a-0a6945c2907d" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Created reservations ['b8c3ed0c-3207-4621-88be-a002a101ca53', 'd4fbb163-6cb2-43b3-984c-08d48787c125', 'df1807d7-3e94-474b-b5e4-a75d03fa9e72', '7f263d89-f3b1-4b64-a09c-f365e2f895d6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:13 devstack sudo[92606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 1G
Jul 17 03:43:13 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-quobyte-b126db7d-a6f7-4533-818a-0a6945c2907d" released by "_delete_snapshot" :: held 2.051s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" released by "delete_snapshot" :: held 2.086s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Created reservations ['c05f31b9-08e4-4ddd-8d50-14e5c32583a4', 'b000f92d-03ed-4179-8169-c44dbe1976c5', '148281e5-88d8-4d22-b24f-195b22b19dfe', '94deb08c-344c-472c-97ec-a4b2f0718316'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Delete snapshot completed successfully.
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2ee440ef-4002-42a4-a7d9-ca36ad27b946 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-b126db7d-a6f7-4533-818a-0a6945c2907d-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Created reservations ['94969ae8-a52e-489d-85cb-86933f3254b5', '2a499f41-00a7-4fb2-8ef1-934cac6bb866', '3048f4c3-519b-49c7-8ae0-280657e455a5', 'de4e4826-3a3c-47d3-8c89-016ccc574ce4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:13 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 1G" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Downloaded image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume fd055d46-2b86-4e38-a657-253e3cb5bb76 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 for user 5eeca48d545c47e9bb502c59f4a48a46 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Marking volume fd055d46-2b86-4e38-a657-253e3cb5bb76 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Copying metadata from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 to fd055d46-2b86-4e38-a657-253e3cb5bb76. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Creating volume glance metadata for volume fd055d46-2b86-4e38-a657-253e3cb5bb76 backed by image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:13 devstack sudo[92612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:13 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c3b8cef-610f-4973-8d5f-ec203df2b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd055d46-2b86-4e38-a657-253e3cb5bb76', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ccb6e10>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7df8e89-63c8-4ab9-a8ce-f60e351c915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Volume volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 (fd055d46-2b86-4e38-a657-253e3cb5bb76): created successfully
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7df8e89-63c8-4ab9-a8ce-f60e351c915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Flow 'volume_create_manager' (49eda6ce-0201-4933-b545-a612ed30f673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-03c71839-8201-4abb-a216-cb715f36a11c tempest-VolumesImageMetadata-147831496 None] Created volume successfully.
Jul 17 03:43:13 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f6bed31-36c7-4934-871b-78032764df9e tempest-GroupSnapshotsTest-814293863 None] Delete group completed successfully.
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "cinder-ea4e4b22-c16e-448a-872c-32232428ed61-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-ea4e4b22-c16e-448a-872c-32232428ed61-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Acquiring lock "cinder-fd055d46-2b86-4e38-a657-253e3cb5bb76-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a58d2-228a-4946-bb5c-a4647068f2ed]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Lock "cinder-fd055d46-2b86-4e38-a657-253e3cb5bb76-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Acquiring lock "cinder-quobyte-fd055d46-2b86-4e38-a657-253e3cb5bb76" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Lock "cinder-quobyte-fd055d46-2b86-4e38-a657-253e3cb5bb76" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58c22ad-f96b-4742-ad0e-17e864590c8b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:14 devstack sudo[92616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61
Jul 17 03:43:14 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:14 devstack sudo[92617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76
Jul 17 03:43:14 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:14 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61" returned: 0 in 0.551s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:15 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61
Jul 17 03:43:15 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:15 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fbe4f800-aa04-436a-b62a-6c18a77527f7 tempest-GroupSnapshotsTest-814293863 None] Group tempest-GroupSnapshotsTest-Group-2126783432: creating
Jul 17 03:43:15 devstack sudo[92630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76
Jul 17 03:43:15 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fbe4f800-aa04-436a-b62a-6c18a77527f7 tempest-GroupSnapshotsTest-814293863 None] Group tempest-GroupSnapshotsTest-Group-2126783432: created successfully
Jul 17 03:43:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fbe4f800-aa04-436a-b62a-6c18a77527f7 tempest-GroupSnapshotsTest-814293863 None] Create group completed successfully.
Jul 17 03:43:15 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ea4e4b22-c16e-448a-872c-32232428ed61" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-quobyte-ea4e4b22-c16e-448a-872c-32232428ed61" released by "delete_volume" :: held 0.991s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:15 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fd055d46-2b86-4e38-a657-253e3cb5bb76" returned: 0 in 0.324s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Lock "cinder-quobyte-fd055d46-2b86-4e38-a657-253e3cb5bb76" released by "delete_volume" :: held 0.959s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Created reservations ['771ddf6e-364e-4081-b39c-f2b32a2e98d8', '2bb724f9-1eda-45c1-9f7d-6ac5c0471a10', '2303ff8b-bdc3-44d9-97f3-df43861ca04c', 'f1fa79d1-f620-4d13-8d02-6f888044b30a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Created reservations ['c85fe6fd-e7fa-4d92-9463-8011e8dc425d', 'e562e926-73b4-4c32-9347-a059c5aa7284', 'eb93c7ac-8497-43ea-abe0-179307e8b760', '9f15805a-32fe-48f9-a7d4-52c6c6f2d33f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:15 devstack sudo[92635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:15 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:15 devstack sudo[92637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:15 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:15 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Deleted volume successfully.
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1db58670-c519-4dac-9788-d44a976f4bc1 tempest-SnapshotsActionsTest-233783043 None] Lock "cinder-ea4e4b22-c16e-448a-872c-32232428ed61-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:15 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Deleted volume successfully.
Jul 17 03:43:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e120b871-fc68-4556-9b36-83870c20c6f9 tempest-VolumesImageMetadata-147831496 None] Lock "cinder-fd055d46-2b86-4e38-a657-253e3cb5bb76-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (8eb1ff47-6dcf-4476-8527-fb94e50f1a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bc09e1-bf15-426e-a538-7e25faaaf505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22bc09e1-bf15-426e-a538-7e25faaaf505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1348628771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef1ff770-7826-4ecb-a6ec-fdc915680963,host='devstack@QuobyteHD#QuobyteHD',id=2c4bcd8f-a718-433d-aa47-39632ef85135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:17Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358d4a48-5ba8-4df5-bd26-f7d6ba4db2ee),volume_type_id=358d4a48-5ba8-4df5-bd26-f7d6ba4db2ee)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800541eb-e535-4105-b4a7-f284855181d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800541eb-e535-4105-b4a7-f284855181d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13841a7-07c7-4f4c-bf98-eeeaac49568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13841a7-07c7-4f4c-bf98-eeeaac49568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4bcd8f-a718-433d-aa47-39632ef85135', 'volume_name': 'volume-2c4bcd8f-a718-433d-aa47-39632ef85135', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a213c58f-c175-4073-a792-280e065a6b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a213c58f-c175-4073-a792-280e065a6b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852623c5-a1c1-4f60-8638-7127b7ba6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Volume 2c4bcd8f-a718-433d-aa47-39632ef85135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4bcd8f-a718-433d-aa47-39632ef85135', 'volume_size': 1}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ef1ff770-7826-4ecb-a6ec-fdc915680963,created_at=2026-07-17T01:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1348628771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef1ff770-7826-4ecb-a6ec-fdc915680963,host='devstack@QuobyteHD#QuobyteHD',id=2c4bcd8f-a718-433d-aa47-39632ef85135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee93472649564704bf85915414a04a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:17Z,use_quota=True,user_id='16ae530a907947ea82b88d3a95a92ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(358d4a48-5ba8-4df5-bd26-f7d6ba4db2ee),volume_type_id=358d4a48-5ba8-4df5-bd26-f7d6ba4db2ee)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Creating volume 2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:16 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:16 devstack sudo[92641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 1073741824
Jul 17 03:43:16 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:17 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 1073741824" returned: 0 in 0.476s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:17 devstack sudo[92647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135
Jul 17 03:43:17 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:17 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852623c5-a1c1-4f60-8638-7127b7ba6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4bcd8f-a718-433d-aa47-39632ef85135', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5312ab13-93e8-4ad9-bc15-50f5237bdfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Volume volume-2c4bcd8f-a718-433d-aa47-39632ef85135 (2c4bcd8f-a718-433d-aa47-39632ef85135): created successfully
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5312ab13-93e8-4ad9-bc15-50f5237bdfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Flow 'volume_create_manager' (8eb1ff47-6dcf-4476-8527-fb94e50f1a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2cefafae-a9f8-480a-97da-a800347dbb12 tempest-GroupSnapshotsTest-814293863 None] Created volume successfully.
Jul 17 03:43:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] GroupSnapshot ffec7b21-4d5d-4d2a-b811-8387c86055a1: creating.
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Group snapshot ffec7b21-4d5d-4d2a-b811-8387c86055a1: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Creating offline snapshot 24f5a821-22c6-4ef9-a864-7af749c8878b of volume 2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8624a1c-010c-4c30-99a8-1cae5be7b12f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:18 devstack sudo[92650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135
Jul 17 03:43:18 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:18 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135" returned: 0 in 0.459s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:18 devstack sudo[92655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b 1G
Jul 17 03:43:18 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:19 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b 1G" returned: 0 in 0.673s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4bcd8f-a718-433d-aa47-39632ef85135 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:19 devstack sudo[92663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4bcd8f-a718-433d-aa47-39632ef85135 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b
Jul 17 03:43:19 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:19 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c4bcd8f-a718-433d-aa47-39632ef85135 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:19 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:43:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:20 devstack sudo[92669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b
Jul 17 03:43:20 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:20 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:20 devstack sudo[92672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.info
Jul 17 03:43:20 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:20 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.info" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:20 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:43:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:20 devstack sudo[92675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.info
Jul 17 03:43:20 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:20 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.info" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4e7a59c1-8011-4027-a186-6ab35206d25e tempest-GroupSnapshotsTest-814293863 None] group_snapshot ffec7b21-4d5d-4d2a-b811-8387c86055a1: created successfully
Jul 17 03:43:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] group_snapshot ffec7b21-4d5d-4d2a-b811-8387c86055a1: deleting
Jul 17 03:43:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] group_snapshot ffec7b21-4d5d-4d2a-b811-8387c86055a1: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 17 03:43:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-2c4bcd8f-a718-433d-aa47-39632ef85135" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-2c4bcd8f-a718-433d-aa47-39632ef85135" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-24f5a821-22c6-4ef9-a864-7af749c8878b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-24f5a821-22c6-4ef9-a864-7af749c8878b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Deleting offline snapshot 24f5a821-22c6-4ef9-a864-7af749c8878b of volume 2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] snapshot_file for this snap is: volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc20dd8-3385-4741-a6eb-bec143dc81a2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:22 devstack sudo[92678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b
Jul 17 03:43:22 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:22 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b" returned: 0 in 0.509s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c4bcd8f-a718-433d-aa47-39632ef85135(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa749bc-69a5-448d-bd81-b60ec7a1095a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:22 devstack sudo[92683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135
Jul 17 03:43:22 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:23 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135" returned: 0 in 0.607s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:23 devstack sudo[92689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b
Jul 17 03:43:23 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Flow 'volume_create_manager' (84a36ffd-7fa3-424a-bbcd-148c672263ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c51648-34af-4787-94d4-d52b92c19605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:23 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c51648-34af-4787-94d4-d52b92c19605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-192413762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10d750b-2d37-4545-bd8a-1bb728fb3a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4577c361836440bfa53cf7ac24a01adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:24Z,use_quota=True,user_id='5d6b79222da24b6aaec5c7beaeb44928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1fc9ed-ed52-4a38-b8d2-b7876b0983f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1fc9ed-ed52-4a38-b8d2-b7876b0983f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383ec869-f186-4623-9987-d3f060bacac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383ec869-f186-4623-9987-d3f060bacac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10d750b-2d37-4545-bd8a-1bb728fb3a97', 'volume_name': 'volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a279d68c-7176-4c6a-a967-251eb279a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a279d68c-7176-4c6a-a967-251eb279a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff02c252-8e9c-4959-b241-f29f6794f53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Volume e10d750b-2d37-4545-bd8a-1bb728fb3a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97', 'volume_size': 1}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-192413762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10d750b-2d37-4545-bd8a-1bb728fb3a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4577c361836440bfa53cf7ac24a01adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:24Z,use_quota=True,user_id='5d6b79222da24b6aaec5c7beaeb44928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Creating volume e10d750b-2d37-4545-bd8a-1bb728fb3a97 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b" returned: 0 in 0.614s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:23 devstack sudo[92695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97 1073741824
Jul 17 03:43:23 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:23 devstack sudo[92696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b
Jul 17 03:43:23 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:24 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135.24f5a821-22c6-4ef9-a864-7af749c8878b" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-24f5a821-22c6-4ef9-a864-7af749c8878b" released by "_delete_snapshot" :: held 2.196s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-2c4bcd8f-a718-433d-aa47-39632ef85135" released by "delete_snapshot" :: held 2.242s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:24 devstack cinder-volume[87498]: WARNING cinder.quota [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1809062783 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1809062783, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:43:24 devstack cinder-volume[87498]: WARNING cinder.quota [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1809062783 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1809062783, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] Created reservations ['06d60fd2-43c9-416d-bced-a6777666a9ac', 'dc8f75d4-be6c-47d4-b345-5fd3c2e79b49', 'ca284a67-5bbb-44ea-b8f2-bd14ab413a60', '47cad9d2-fb6a-42c5-ab67-2e91b280e61b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:24 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97 1073741824" returned: 0 in 0.691s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4d06f302-2f07-4b5f-8b07-aa7a635f486f tempest-GroupSnapshotsTest-814293863 None] group_snapshot ffec7b21-4d5d-4d2a-b811-8387c86055a1: deleted successfully
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:24 devstack sudo[92703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97
Jul 17 03:43:24 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:24 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff02c252-8e9c-4959-b241-f29f6794f53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a168c9c-7afa-455b-aadd-2a40beab11f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Volume volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97 (e10d750b-2d37-4545-bd8a-1bb728fb3a97): created successfully
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a168c9c-7afa-455b-aadd-2a40beab11f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Flow 'volume_create_manager' (84a36ffd-7fa3-424a-bbcd-148c672263ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2a8dbe96-0de6-429c-8143-e9088dc1ed38 tempest-VolumesTransfersTest-1039624867 None] Created volume successfully.
Jul 17 03:43:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "cinder-quobyte-2c4bcd8f-a718-433d-aa47-39632ef85135" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-2c4bcd8f-a718-433d-aa47-39632ef85135" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73ceb61-8dbf-4cce-a784-4726b3443be8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:26 devstack sudo[92707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135
Jul 17 03:43:26 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:26 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:26 devstack sudo[92712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135
Jul 17 03:43:26 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:26 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2c4bcd8f-a718-433d-aa47-39632ef85135" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Lock "cinder-quobyte-2c4bcd8f-a718-433d-aa47-39632ef85135" released by "delete_volume" :: held 0.949s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Created reservations ['9a70a453-e91d-4e66-8abd-381f645e3af8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:26 devstack cinder-volume[87498]: WARNING cinder.quota [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1809062783 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1809062783, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Created reservations ['10d4afe1-261c-4124-9711-d3e1c2844ffa', 'd017ec57-6398-494d-9139-9fd95f690607', '31688519-40fc-49f4-89be-a2dd4babf9ad', '11c22a6d-7bcc-402a-8ebc-f43c0188d6c6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:27 devstack sudo[92715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:27 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-071a4d68-4f6a-4811-96db-d288df052ce0 tempest-VolumesTransfersTest-1771100194 None] Transfer volume completed successfully.
Jul 17 03:43:27 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4aa5beb7-2f93-4917-a132-e2805056419b tempest-GroupSnapshotsTest-814293863 None] Delete group completed successfully.
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Acquiring lock "cinder-e10d750b-2d37-4545-bd8a-1bb728fb3a97-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-e10d750b-2d37-4545-bd8a-1bb728fb3a97-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Acquiring lock "cinder-quobyte-e10d750b-2d37-4545-bd8a-1bb728fb3a97" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-quobyte-e10d750b-2d37-4545-bd8a-1bb728fb3a97" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d7577e-f095-4f1a-ae9e-1effed52b5c6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:28 devstack sudo[92752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97
Jul 17 03:43:28 devstack sudo[92752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:28 devstack sudo[92752]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97" returned: 0 in 0.499s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:28 devstack sudo[92757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97
Jul 17 03:43:28 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:29 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e10d750b-2d37-4545-bd8a-1bb728fb3a97" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-quobyte-e10d750b-2d37-4545-bd8a-1bb728fb3a97" released by "delete_volume" :: held 0.896s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Created reservations ['8b8d0f86-be9e-4cfc-810e-6b346cdc95da', 'c735fe87-d979-4781-9b9e-dcaa41950c56', 'bd3d702f-5952-46d8-afaf-2281557a8792', 'b9a283df-7a04-4965-80cb-49ed156c33c4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:29 devstack sudo[92762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:29 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:29 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Deleted volume successfully.
Jul 17 03:43:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-feb60681-342c-453e-9d86-b2ad7a9ec836 tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-e10d750b-2d37-4545-bd8a-1bb728fb3a97-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Flow 'volume_create_manager' (bc140700-a93d-4d7e-b7ab-4074945dab7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657e2aa1-c594-4c07-86c3-7f02ea4cbcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657e2aa1-c594-4c07-86c3-7f02ea4cbcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1111504370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207fde2d-415b-44ba-8f77-db56968e6d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4577c361836440bfa53cf7ac24a01adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:31Z,use_quota=True,user_id='5d6b79222da24b6aaec5c7beaeb44928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a72a5ec-3e95-495a-896e-40b9c3fbedb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a72a5ec-3e95-495a-896e-40b9c3fbedb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c138bc22-48fb-410c-b1b3-97b9aed8e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c138bc22-48fb-410c-b1b3-97b9aed8e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207fde2d-415b-44ba-8f77-db56968e6d59', 'volume_name': 'volume-207fde2d-415b-44ba-8f77-db56968e6d59', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ad7da0-3e33-46b2-8ff2-979bad09f892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ad7da0-3e33-46b2-8ff2-979bad09f892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab441ed0-0146-4428-bf4a-2b3b8796b3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Volume 207fde2d-415b-44ba-8f77-db56968e6d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207fde2d-415b-44ba-8f77-db56968e6d59', 'volume_size': 1}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1111504370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207fde2d-415b-44ba-8f77-db56968e6d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4577c361836440bfa53cf7ac24a01adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:31Z,use_quota=True,user_id='5d6b79222da24b6aaec5c7beaeb44928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Creating volume 207fde2d-415b-44ba-8f77-db56968e6d59 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:31 devstack sudo[92766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59 1073741824
Jul 17 03:43:31 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:31 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59 1073741824" returned: 0 in 0.573s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:32 devstack sudo[92772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59
Jul 17 03:43:32 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:32 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab441ed0-0146-4428-bf4a-2b3b8796b3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207fde2d-415b-44ba-8f77-db56968e6d59', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85622a45-4f61-457f-b50c-52ee56dad965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Volume volume-207fde2d-415b-44ba-8f77-db56968e6d59 (207fde2d-415b-44ba-8f77-db56968e6d59): created successfully
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85622a45-4f61-457f-b50c-52ee56dad965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Flow 'volume_create_manager' (bc140700-a93d-4d7e-b7ab-4074945dab7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-88cc47fc-8947-4e31-b73d-dcd8919aa301 tempest-VolumesTransfersTest-1039624867 None] Created volume successfully.
Jul 17 03:43:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Acquiring lock "cinder-207fde2d-415b-44ba-8f77-db56968e6d59-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-207fde2d-415b-44ba-8f77-db56968e6d59-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Acquiring lock "cinder-quobyte-207fde2d-415b-44ba-8f77-db56968e6d59" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-quobyte-207fde2d-415b-44ba-8f77-db56968e6d59" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b51074f-10b0-497b-b38f-92ecc541b885]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:34 devstack sudo[92775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59
Jul 17 03:43:34 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:34 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:34 devstack sudo[92780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59
Jul 17 03:43:34 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:34 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-207fde2d-415b-44ba-8f77-db56968e6d59" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-quobyte-207fde2d-415b-44ba-8f77-db56968e6d59" released by "delete_volume" :: held 0.911s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Created reservations ['9f68f8d3-d2c6-41ad-bf4b-340b283acae0', '0cc1c375-2a8c-4722-878e-38e43edd7d9c', '87cd20b6-fc98-43df-bdfc-5527e1454f26', '9077938f-9250-4d5f-b773-9cbc3d013b54'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:35 devstack sudo[92786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:35 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:35 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Deleted volume successfully.
Jul 17 03:43:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e330b912-027c-4d07-b2f6-efe0a2754f4c tempest-VolumesTransfersTest-1707069926 None] Lock "cinder-207fde2d-415b-44ba-8f77-db56968e6d59-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Flow 'volume_create_manager' (8a89f191-58b4-42c8-8b25-39a777bb0ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ca5d37-4177-4fb8-ba72-429050717171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ca5d37-4177-4fb8-ba72-429050717171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-445013408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbadbd0-c875-435f-8d7a-00743ac994c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d00224f1db4c51a54bbd2436f99913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:39Z,use_quota=True,user_id='0a302dcbb58f414faa598f3b8cd721b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3cf1a9-b51a-42bc-9818-d7d547995fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3cf1a9-b51a-42bc-9818-d7d547995fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf805f9-e465-4372-98e3-a76675d55735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf805f9-e465-4372-98e3-a76675d55735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fbadbd0-c875-435f-8d7a-00743ac994c8', 'volume_name': 'volume-7fbadbd0-c875-435f-8d7a-00743ac994c8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6947d704-7bdc-4798-9a05-77f9604786cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6947d704-7bdc-4798-9a05-77f9604786cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f4a6ff-de07-474c-8df1-24cc15486558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Volume 7fbadbd0-c875-435f-8d7a-00743ac994c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fbadbd0-c875-435f-8d7a-00743ac994c8', 'volume_size': 1}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-445013408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fbadbd0-c875-435f-8d7a-00743ac994c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d00224f1db4c51a54bbd2436f99913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:39Z,use_quota=True,user_id='0a302dcbb58f414faa598f3b8cd721b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Creating volume 7fbadbd0-c875-435f-8d7a-00743ac994c8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:39 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:39 devstack sudo[92833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8 1073741824
Jul 17 03:43:39 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:39 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8 1073741824" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:40 devstack sudo[92841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8
Jul 17 03:43:40 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:40 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f4a6ff-de07-474c-8df1-24cc15486558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fbadbd0-c875-435f-8d7a-00743ac994c8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc302f2-1a77-4893-811b-6821461f8b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Volume volume-7fbadbd0-c875-435f-8d7a-00743ac994c8 (7fbadbd0-c875-435f-8d7a-00743ac994c8): created successfully
Jul 17 03:43:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc302f2-1a77-4893-811b-6821461f8b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Flow 'volume_create_manager' (8a89f191-58b4-42c8-8b25-39a777bb0ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-90871574-50a7-4ce6-bfb0-2025299d90ac tempest-VolumesListAdminTestJSON-1566808597 None] Created volume successfully.
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Flow 'volume_create_manager' (b2d90cee-bb33-45ca-856c-01473491789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbc9fea-cdf5-4afe-924f-6ad856b4460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbbc9fea-cdf5-4afe-924f-6ad856b4460a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1929369193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c622194b-cd30-4eba-935b-a24eb1f8baeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d00224f1db4c51a54bbd2436f99913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:42Z,use_quota=True,user_id='0a302dcbb58f414faa598f3b8cd721b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6226ba20-fc58-46f7-ab99-568a35f7981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6226ba20-fc58-46f7-ab99-568a35f7981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d6258c-845a-46a9-9423-e098429e655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d6258c-845a-46a9-9423-e098429e655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c622194b-cd30-4eba-935b-a24eb1f8baeb', 'volume_name': 'volume-c622194b-cd30-4eba-935b-a24eb1f8baeb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c191363-d954-4220-9fc6-dfef13c2492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c191363-d954-4220-9fc6-dfef13c2492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95513bd0-9499-4fda-9574-43ea11107684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Volume c622194b-cd30-4eba-935b-a24eb1f8baeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c622194b-cd30-4eba-935b-a24eb1f8baeb', 'volume_size': 1}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1929369193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c622194b-cd30-4eba-935b-a24eb1f8baeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d00224f1db4c51a54bbd2436f99913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:42Z,use_quota=True,user_id='0a302dcbb58f414faa598f3b8cd721b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Creating volume c622194b-cd30-4eba-935b-a24eb1f8baeb {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:42 devstack sudo[92847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb 1073741824
Jul 17 03:43:42 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:43 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb 1073741824" returned: 0 in 1.198s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:43 devstack sudo[92920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb
Jul 17 03:43:43 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:44 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb" returned: 0 in 0.908s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] <== create_volume: return (2261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95513bd0-9499-4fda-9574-43ea11107684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c622194b-cd30-4eba-935b-a24eb1f8baeb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d748cf-2b9e-41fc-bbd0-5015ec3d7499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Volume volume-c622194b-cd30-4eba-935b-a24eb1f8baeb (c622194b-cd30-4eba-935b-a24eb1f8baeb): created successfully
Jul 17 03:43:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d748cf-2b9e-41fc-bbd0-5015ec3d7499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Flow 'volume_create_manager' (b2d90cee-bb33-45ca-856c-01473491789c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-37dc743d-4b70-4d2a-a09c-d6be8b941da6 tempest-VolumesListAdminTestJSON-1566808597 None] Created volume successfully.
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Flow 'volume_create_manager' (9ccc2935-0bbb-4e40-af28-c35fdd86e827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb05017-4e23-40a9-9aca-5c680bc12e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb05017-4e23-40a9-9aca-5c680bc12e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-499357316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732515ea-7a7f-4e93-90a5-8b247464f10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d00224f1db4c51a54bbd2436f99913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:47Z,use_quota=True,user_id='0a302dcbb58f414faa598f3b8cd721b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d685a1a2-10a7-4b73-8cdd-a88d7e97ea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d685a1a2-10a7-4b73-8cdd-a88d7e97ea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe170daf-666b-4bee-88f5-832c15ab7e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe170daf-666b-4bee-88f5-832c15ab7e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732515ea-7a7f-4e93-90a5-8b247464f10a', 'volume_name': 'volume-732515ea-7a7f-4e93-90a5-8b247464f10a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64d6b6c-e62b-416d-a3cb-e7dc3f3d686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64d6b6c-e62b-416d-a3cb-e7dc3f3d686b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af784a8-dd5a-4fc5-b0ee-fa5ccc631f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Volume 732515ea-7a7f-4e93-90a5-8b247464f10a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732515ea-7a7f-4e93-90a5-8b247464f10a', 'volume_size': 1}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-499357316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732515ea-7a7f-4e93-90a5-8b247464f10a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67d00224f1db4c51a54bbd2436f99913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:47Z,use_quota=True,user_id='0a302dcbb58f414faa598f3b8cd721b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Creating volume 732515ea-7a7f-4e93-90a5-8b247464f10a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:47 devstack sudo[92975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a 1073741824
Jul 17 03:43:47 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:48 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a 1073741824" returned: 0 in 0.989s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:48 devstack sudo[92988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a
Jul 17 03:43:48 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:49 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a" returned: 0 in 0.489s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af784a8-dd5a-4fc5-b0ee-fa5ccc631f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732515ea-7a7f-4e93-90a5-8b247464f10a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d30775-fee6-4079-bf57-9afd2c0f0768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Volume volume-732515ea-7a7f-4e93-90a5-8b247464f10a (732515ea-7a7f-4e93-90a5-8b247464f10a): created successfully
Jul 17 03:43:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d30775-fee6-4079-bf57-9afd2c0f0768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Flow 'volume_create_manager' (9ccc2935-0bbb-4e40-af28-c35fdd86e827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1e8caf82-326d-4b3f-89d6-7786aff1a831 tempest-VolumesListAdminTestJSON-1566808597 None] Created volume successfully.
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Flow 'volume_create_manager' (67b4c7bc-ae34-41c1-bfd9-448476962fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e46bb96-6de1-4c79-8cf5-b59f5fe12cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e46bb96-6de1-4c79-8cf5-b59f5fe12cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391be90b-a13c-47ba-821f-8859376ae72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc44a75cde59442aae97477ef2944eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:51Z,use_quota=True,user_id='2a8bbe5b3eed411b9496299662cfad0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a44531e-46ae-4148-9340-36a89b0c93b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a44531e-46ae-4148-9340-36a89b0c93b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e65477f-60be-44f9-bb6b-4ddac63ed3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e65477f-60be-44f9-bb6b-4ddac63ed3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '391be90b-a13c-47ba-821f-8859376ae72d', 'volume_name': 'volume-391be90b-a13c-47ba-821f-8859376ae72d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89ea727-d80c-46fe-a272-509ff3ecab46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b89ea727-d80c-46fe-a272-509ff3ecab46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8896d4b-b369-4d32-a66b-676bb3b1ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Volume 391be90b-a13c-47ba-821f-8859376ae72d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-391be90b-a13c-47ba-821f-8859376ae72d', 'volume_size': 1}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391be90b-a13c-47ba-821f-8859376ae72d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc44a75cde59442aae97477ef2944eb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:51Z,use_quota=True,user_id='2a8bbe5b3eed411b9496299662cfad0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Creating volume 391be90b-a13c-47ba-821f-8859376ae72d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:51 devstack sudo[93027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d 1073741824
Jul 17 03:43:51 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Flow 'volume_create_manager' (23e922bc-f86f-424e-9134-53a9edf9919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1805e8-d85d-404a-9ed6-7c86f474c31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1805e8-d85d-404a-9ed6-7c86f474c31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-204552615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af66e2c-791b-4ba0-b062-368edc14a0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0420d38ffdfd4b95a04ba4e002fe4e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:51Z,use_quota=True,user_id='c4733b2cff1149c78659eb7bfd9b5b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a8fc0d-996e-4185-ab14-74f99ccd1a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a8fc0d-996e-4185-ab14-74f99ccd1a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6f6a7c-cd2f-4dba-9d1e-03770d6fcc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6f6a7c-cd2f-4dba-9d1e-03770d6fcc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af66e2c-791b-4ba0-b062-368edc14a0a0', 'volume_name': 'volume-8af66e2c-791b-4ba0-b062-368edc14a0a0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb1db7d-e9e5-43e2-8ff7-abcd3c04283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb1db7d-e9e5-43e2-8ff7-abcd3c04283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f0bc6-ddb6-44f9-a0ac-e09f5c20e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Volume 8af66e2c-791b-4ba0-b062-368edc14a0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af66e2c-791b-4ba0-b062-368edc14a0a0', 'volume_size': 1}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:51 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d 1073741824" returned: 0 in 0.923s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:51 devstack sudo[93032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d
Jul 17 03:43:51 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:52 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d" returned: 0 in 0.452s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-204552615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af66e2c-791b-4ba0-b062-368edc14a0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0420d38ffdfd4b95a04ba4e002fe4e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:51Z,use_quota=True,user_id='c4733b2cff1149c78659eb7bfd9b5b94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Creating volume 8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8896d4b-b369-4d32-a66b-676bb3b1ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-391be90b-a13c-47ba-821f-8859376ae72d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96107e42-698e-4ce7-9d67-059926d2327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Volume volume-391be90b-a13c-47ba-821f-8859376ae72d (391be90b-a13c-47ba-821f-8859376ae72d): created successfully
Jul 17 03:43:52 devstack sudo[93036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 1073741824
Jul 17 03:43:52 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96107e42-698e-4ce7-9d67-059926d2327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Flow 'volume_create_manager' (67b4c7bc-ae34-41c1-bfd9-448476962fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9a61756e-de3c-4927-ae8e-2e8faf20e40f tempest-VolumesListAdminTestJSON-566314466 None] Created volume successfully.
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Acquiring lock "cinder-391be90b-a13c-47ba-821f-8859376ae72d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Lock "cinder-391be90b-a13c-47ba-821f-8859376ae72d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:53 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 1073741824" returned: 0 in 0.876s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Acquiring lock "cinder-quobyte-391be90b-a13c-47ba-821f-8859376ae72d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:53 devstack sudo[93042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0
Jul 17 03:43:53 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "cinder-732515ea-7a7f-4e93-90a5-8b247464f10a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Lock "cinder-quobyte-391be90b-a13c-47ba-821f-8859376ae72d" acquired by "delete_volume" :: waited 0.119s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-732515ea-7a7f-4e93-90a5-8b247464f10a-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc56e0da-381e-455a-8745-10c1518e32b3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "cinder-quobyte-732515ea-7a7f-4e93-90a5-8b247464f10a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-quobyte-732515ea-7a7f-4e93-90a5-8b247464f10a" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fe426d-6f9f-48fe-8478-57fbd115d7b0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:53 devstack sudo[93044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d
Jul 17 03:43:53 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:54 devstack sudo[93045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a
Jul 17 03:43:54 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:54 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0" returned: 0 in 0.725s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=133,cinder:UPDATE=157,cinder:DELETE=7,cinder:INSERT=41 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f0bc6-ddb6-44f9-a0ac-e09f5c20e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af66e2c-791b-4ba0-b062-368edc14a0a0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:54 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ce7a7f-9c2f-46ff-a357-ff58eb73b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=151,cinder:UPDATE=147,cinder:INSERT=46,cinder:DELETE=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d" returned: 0 in 0.707s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Volume volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 (8af66e2c-791b-4ba0-b062-368edc14a0a0): created successfully
Jul 17 03:43:54 devstack sudo[93052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d
Jul 17 03:43:54 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36ce7a7f-9c2f-46ff-a357-ff58eb73b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Flow 'volume_create_manager' (23e922bc-f86f-424e-9134-53a9edf9919b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9bd22295-d9f6-42dc-976e-e14327998f97 tempest-VolumesSnapshotListTestJSON-1175310433 None] Created volume successfully.
Jul 17 03:43:54 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a" returned: 0 in 0.784s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:54 devstack sudo[93057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a
Jul 17 03:43:54 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:55 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-732515ea-7a7f-4e93-90a5-8b247464f10a" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-quobyte-732515ea-7a7f-4e93-90a5-8b247464f10a" released by "delete_volume" :: held 1.293s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:55 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-391be90b-a13c-47ba-821f-8859376ae72d" returned: 0 in 0.749s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Lock "cinder-quobyte-391be90b-a13c-47ba-821f-8859376ae72d" released by "delete_volume" :: held 1.584s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Created reservations ['cb97869e-6dc6-4096-b61a-027a0628bdd3', '4f5181f9-c212-4424-9da9-1fb1921b4b64', '2a4477e8-33de-482f-88aa-4fef57885f06', 'd0a83d0c-6e60-4f7f-b3d7-b356da8a95d1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Created reservations ['593f11ca-8a89-49ae-8733-f3a8e3bc40e8', 'edd037df-32f1-4a1a-97bf-a7016221ceb7', '5897f7f5-600f-4aeb-90e5-adbb6eee06b3', 'f1b2699f-9801-4589-8a62-137686cbe313'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:55 devstack sudo[93062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:55 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:55 devstack sudo[93064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:55 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:43:56 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Flow 'volume_create_manager' (5de80d73-ff1c-4187-9c65-28240d271c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465505c8-8a6e-4542-b21f-48f0e6150e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.663s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465505c8-8a6e-4542-b21f-48f0e6150e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-786715667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a49b4bd-8ff7-41e4-a81f-2035c5a7b006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4760b417419b47bea9342755ecc9c986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:56Z,use_quota=True,user_id='7b4fdb0aac9243e2bf948c39b21c37e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5790475f-5a08-44f7-9833-8c3633b55082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5790475f-5a08-44f7-9833-8c3633b55082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc21eec5-c9fb-42b2-8d97-12b58cbac72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc21eec5-c9fb-42b2-8d97-12b58cbac72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a49b4bd-8ff7-41e4-a81f-2035c5a7b006', 'volume_name': 'volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c06225b-3c2f-4efa-9476-66277846bcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c06225b-3c2f-4efa-9476-66277846bcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540db1ef-885f-407e-ba34-1209c205c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Volume 8a49b4bd-8ff7-41e4-a81f-2035c5a7b006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006', 'volume_size': 1}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:43:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-786715667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a49b4bd-8ff7-41e4-a81f-2035c5a7b006,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4760b417419b47bea9342755ecc9c986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:43:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:43:56Z,use_quota=True,user_id='7b4fdb0aac9243e2bf948c39b21c37e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Creating volume 8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:43:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Deleted volume successfully.
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad113f9b-6706-4c2c-afc8-5d366fe43c39 tempest-VolumesListAdminTestJSON-566314466 None] Lock "cinder-391be90b-a13c-47ba-821f-8859376ae72d-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:56 devstack sudo[93068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 1073741824
Jul 17 03:43:56 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:56 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.788s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Deleted volume successfully.
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b15f69b1-9d57-4153-95e1-9f3dfdf99864 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-732515ea-7a7f-4e93-90a5-8b247464f10a-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "cinder-c622194b-cd30-4eba-935b-a24eb1f8baeb-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-c622194b-cd30-4eba-935b-a24eb1f8baeb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "cinder-quobyte-c622194b-cd30-4eba-935b-a24eb1f8baeb" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-quobyte-c622194b-cd30-4eba-935b-a24eb1f8baeb" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[93607f28-408b-4e16-b86c-bb472a00c7a4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:57 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb
Jul 17 03:43:57 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:57 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 1073741824" returned: 0 in 0.896s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:57 devstack sudo[93079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006
Jul 17 03:43:57 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:57 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb" returned: 0 in 0.590s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:57 devstack sudo[93082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb
Jul 17 03:43:57 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:57 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006" returned: 0 in 0.528s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.509s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540db1ef-885f-407e-ba34-1209c205c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc9ff3e-ce01-474e-9ee4-5375ebb28e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Creating offline snapshot 824dfe01-9a48-408a-b154-e39a47fd5b00 of volume 8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:43:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Volume volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 (8a49b4bd-8ff7-41e4-a81f-2035c5a7b006): created successfully
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc9ff3e-ce01-474e-9ee4-5375ebb28e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Flow 'volume_create_manager' (5de80d73-ff1c-4187-9c65-28240d271c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b1157-94e7-4138-83c4-5dc349eae87b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:57 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c622194b-cd30-4eba-935b-a24eb1f8baeb" returned: 0 in 0.603s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-quobyte-c622194b-cd30-4eba-935b-a24eb1f8baeb" released by "delete_volume" :: held 1.294s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dffc3135-9558-4511-ad57-fba7c01ce0f2 tempest-ServerRescueNegativeTestJSON-1591986137 None] Created volume successfully.
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Created reservations ['0fc565b5-7019-409b-81ef-9cff1ebce934', 'b668a075-aa41-4dfb-85d5-98012c2ae0a3', 'a060d5da-2e95-4c02-8825-f5c3f32d2599', 'a9a313f0-1e77-414d-a354-d24ca0c503d6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:43:58 devstack sudo[93086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0
Jul 17 03:43:58 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:58 devstack sudo[93088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:43:58 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:58 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:43:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Deleted volume successfully.
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96451b34-a239-4cac-8b33-b45458359efc tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-c622194b-cd30-4eba-935b-a24eb1f8baeb-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:43:58 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0" returned: 0 in 0.827s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:58 devstack sudo[93094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 1G
Jul 17 03:43:58 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "cinder-7fbadbd0-c875-435f-8d7a-00743ac994c8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-7fbadbd0-c875-435f-8d7a-00743ac994c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "cinder-quobyte-7fbadbd0-c875-435f-8d7a-00743ac994c8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-quobyte-7fbadbd0-c875-435f-8d7a-00743ac994c8" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4ad6ad-241d-414f-88ac-af1ae8da7deb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:43:59 devstack sudo[93100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8
Jul 17 03:43:59 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:43:59 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 1G" returned: 0 in 1.181s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:43:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:00 devstack sudo[93113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00
Jul 17 03:44:00 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:00 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8" returned: 0 in 0.910s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:00 devstack sudo[93140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8
Jul 17 03:44:00 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:00 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00" returned: 0 in 0.659s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:00 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 is being set with open permissions: ugo+rw
Jul 17 03:44:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:00 devstack sudo[93142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00
Jul 17 03:44:00 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:00 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7fbadbd0-c875-435f-8d7a-00743ac994c8" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-quobyte-7fbadbd0-c875-435f-8d7a-00743ac994c8" released by "delete_volume" :: held 1.387s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Created reservations ['872eea4d-975e-447b-9de0-ffbef4ed4fee', '8140cd0c-696b-4d17-93f0-69e96ebc1e87', 'cb024e4e-fccc-41f1-9798-82ce8fe3df78', '19a72860-9b76-4ecf-9c78-359f191276ce'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:01 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:01 devstack sudo[93151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.info
Jul 17 03:44:01 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:01 devstack sudo[93153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:01 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:01 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Deleted volume successfully.
Jul 17 03:44:01 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.info" returned: 0 in 0.655s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.info is being set with open permissions: ugo+rw
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:01 devstack sudo[93164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.info
Jul 17 03:44:01 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a49c9707-a5dd-4f53-bcd4-1b3ffeef7ac9 tempest-VolumesListAdminTestJSON-1566808597 None] Lock "cinder-7fbadbd0-c875-435f-8d7a-00743ac994c8-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:02 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.info" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.415s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-538933a3-a002-4301-ba5b-c2a238fe45cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Create snapshot completed successfully
Jul 17 03:44:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Creating offline snapshot 79445221-67e6-487a-9316-ed60a0fd5934 of volume 8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:44:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21464de0-6513-4624-8282-b1e4087644a6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:04 devstack sudo[93193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00
Jul 17 03:44:04 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:05 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00" returned: 0 in 1.073s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af66e2c-791b-4ba0-b062-368edc14a0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:05 devstack sudo[93201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 1G
Jul 17 03:44:05 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:06 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 1G" returned: 0 in 1.118s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:06 devstack sudo[93208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934
Jul 17 03:44:06 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:06 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:06 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 is being set with open permissions: ugo+rw
Jul 17 03:44:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:06 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934
Jul 17 03:44:06 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:07 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.426s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-02e164a6-dcfa-4e7d-877f-c71cd9af5f5f tempest-VolumesSnapshotListTestJSON-1175310433 None] Create snapshot completed successfully
Jul 17 03:44:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Creating offline snapshot e9285d50-c3e1-4733-90af-959eb5ee0bef of volume 8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:44:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e889af-9abf-48c7-8c0f-eae14b89542f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:08 devstack sudo[93268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934
Jul 17 03:44:08 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:09 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af66e2c-791b-4ba0-b062-368edc14a0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:09 devstack sudo[93273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef 1G
Jul 17 03:44:09 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:09 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef 1G" returned: 0 in 0.820s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:09 devstack sudo[93280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef
Jul 17 03:44:09 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:10 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef" returned: 0 in 0.459s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:10 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef is being set with open permissions: ugo+rw
Jul 17 03:44:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:10 devstack sudo[93286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef
Jul 17 03:44:10 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:10 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-caee6677-a8d9-4757-9b74-a3b68486d1cc tempest-VolumesSnapshotListTestJSON-1175310433 None] Create snapshot completed successfully
Jul 17 03:44:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Acquiring lock "cinder-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "cinder-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Acquiring lock "cinder-quobyte-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "cinder-quobyte-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e621d3b-145b-474c-b465-a74dd4b9810f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:11 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006
Jul 17 03:44:11 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:12 devstack sudo[93291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:12 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:12 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006" returned: 0 in 0.680s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:12 devstack sudo[93296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006
Jul 17 03:44:12 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:12 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:44:12 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006" returned: 0 in 0.502s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "cinder-quobyte-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006" released by "delete_volume" :: held 1.293s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Created reservations ['5bed97b1-7dc7-49f1-b587-cd94909bddef', '12352bad-3ba6-40dc-b147-0f3f03986da8', 'e7764ade-ffec-4adb-9915-e020d6756daf', 'd8acc66c-17a3-4fce-aa7e-10dac855bb83'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-e9285d50-c3e1-4733-90af-959eb5ee0bef-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-e9285d50-c3e1-4733-90af-959eb5ee0bef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-quobyte-e9285d50-c3e1-4733-90af-959eb5ee0bef" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:13 devstack sudo[93300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:13 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-e9285d50-c3e1-4733-90af-959eb5ee0bef" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Deleting offline snapshot e9285d50-c3e1-4733-90af-959eb5ee0bef of volume 8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] snapshot_file for this snap is: volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e7d50-2982-42f2-94b8-9053fe83fa6a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:13 devstack sudo[93302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef
Jul 17 03:44:13 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:13 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Deleted volume successfully.
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09151681-0ed0-4485-a774-a901fa279294 tempest-ServerRescueNegativeTestJSON-1591986137 None] Lock "cinder-8a49b4bd-8ff7-41e4-a81f-2035c5a7b006-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:13 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef" returned: 0 in 0.566s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af66e2c-791b-4ba0-b062-368edc14a0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7280451-949b-48c6-8496-fb1ff87e49d8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:14 devstack sudo[93308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934
Jul 17 03:44:14 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:14 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934" returned: 0 in 0.951s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af66e2c-791b-4ba0-b062-368edc14a0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:15 devstack sudo[93334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef
Jul 17 03:44:15 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Flow 'volume_create_manager' (bfb605a5-dad7-4818-be9a-0053be441a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e23cdb0-914b-4f7c-9236-8a76504fa37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e23cdb0-914b-4f7c-9236-8a76504fa37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1961737057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eab386-40dc-496f-9f7a-0383e2b65a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30529e3846a841c8b8822876dfa15fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:16Z,use_quota=True,user_id='187dd66302d2444597cb3ec2fab4df9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee204248-783b-4b45-b290-0fc85deff16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:15 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee204248-783b-4b45-b290-0fc85deff16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44e08e8-85fd-4e77-b7d4-388a14e2b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44e08e8-85fd-4e77-b7d4-388a14e2b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64eab386-40dc-496f-9f7a-0383e2b65a22', 'volume_name': 'volume-64eab386-40dc-496f-9f7a-0383e2b65a22', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25b46a4-5efa-4a6e-9261-e457ab4ef25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25b46a4-5efa-4a6e-9261-e457ab4ef25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a52ccc0-0ceb-4b53-a770-2761e38ba761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Volume 64eab386-40dc-496f-9f7a-0383e2b65a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64eab386-40dc-496f-9f7a-0383e2b65a22', 'volume_size': 1}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1961737057',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64eab386-40dc-496f-9f7a-0383e2b65a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30529e3846a841c8b8822876dfa15fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:16Z,use_quota=True,user_id='187dd66302d2444597cb3ec2fab4df9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Creating volume 64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:44:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:44:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef" returned: 0 in 1.059s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:16 devstack sudo[93349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 1073741824
Jul 17 03:44:16 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:16 devstack sudo[93350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef
Jul 17 03:44:16 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:16 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.e9285d50-c3e1-4733-90af-959eb5ee0bef" returned: 0 in 0.528s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-e9285d50-c3e1-4733-90af-959eb5ee0bef" released by "_delete_snapshot" :: held 3.263s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" released by "delete_snapshot" :: held 3.302s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Created reservations ['c33733d1-0301-4720-81b4-56eaa72f8a71', '41f247cd-830d-4381-9c19-880afb6d0803', '1d49d53e-ee38-4290-9391-e206305cb4f0', '4b4336b1-7555-4742-b62b-22f4f07127d1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:16 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 1073741824" returned: 0 in 0.834s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Delete snapshot completed successfully.
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-536735d4-e578-4d76-97f6-75066722ab6d tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-e9285d50-c3e1-4733-90af-959eb5ee0bef-delete_snapshot" released by "delete_snapshot" :: held 3.598s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:16 devstack sudo[93358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22
Jul 17 03:44:16 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:17 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a52ccc0-0ceb-4b53-a770-2761e38ba761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64eab386-40dc-496f-9f7a-0383e2b65a22', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3254364-1477-4a13-8cfd-90453de9d977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Volume volume-64eab386-40dc-496f-9f7a-0383e2b65a22 (64eab386-40dc-496f-9f7a-0383e2b65a22): created successfully
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3254364-1477-4a13-8cfd-90453de9d977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Flow 'volume_create_manager' (bfb605a5-dad7-4818-be9a-0053be441a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-153d3a2e-4bc1-4436-bc60-44b11a59624e tempest-SnapshotMetadataTestJSON-401793172 None] Created volume successfully.
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-79445221-67e6-487a-9316-ed60a0fd5934-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-79445221-67e6-487a-9316-ed60a0fd5934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-quobyte-79445221-67e6-487a-9316-ed60a0fd5934" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-79445221-67e6-487a-9316-ed60a0fd5934" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Deleting offline snapshot 79445221-67e6-487a-9316-ed60a0fd5934 of volume 8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] snapshot_file for this snap is: volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fffff2-72c8-482e-a435-558b2b7e9434]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:18 devstack sudo[93363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934
Jul 17 03:44:18 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:18 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934" returned: 0 in 0.668s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af66e2c-791b-4ba0-b062-368edc14a0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Flow 'volume_create_manager' (25330d0e-d4b9-499c-8975-e8501dcf8907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17c5721-053b-48af-a4aa-d0cc6465a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0a21f-5540-46e5-b606-6b1bef112a40]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17c5721-053b-48af-a4aa-d0cc6465a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1140946080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805cc1ca-b66a-4008-b45a-74c54b42c3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33759e9dc8ac49f1960297b1682801f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:18Z,use_quota=True,user_id='4859c6be99b34cd0aff75e42ad4ef7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33bdaca-4c36-498c-8924-ca8088e24628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33bdaca-4c36-498c-8924-ca8088e24628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c196da-7378-4737-93b5-d163a5983bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c196da-7378-4737-93b5-d163a5983bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805cc1ca-b66a-4008-b45a-74c54b42c3f7', 'volume_name': 'volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebf3447-3139-4d4c-bcb7-4e673416b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ebf3447-3139-4d4c-bcb7-4e673416b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3685faed-3885-4688-a6f3-d65508b0b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Volume 805cc1ca-b66a-4008-b45a-74c54b42c3f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7', 'volume_size': 1}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Creating offline snapshot d1682858-1b93-4316-9827-50ec36c68c4e of volume 64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c595590-4725-493b-8f50-ad192c76c1d1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:18 devstack sudo[93368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00
Jul 17 03:44:18 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:18 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22
Jul 17 03:44:18 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:19 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00" returned: 0 in 0.498s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af66e2c-791b-4ba0-b062-368edc14a0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:19 devstack sudo[93381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934
Jul 17 03:44:19 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:19 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22" returned: 0 in 0.556s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:19 devstack sudo[93398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e 1G
Jul 17 03:44:19 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:19 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934" returned: 0 in 0.613s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:19 devstack sudo[93419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934
Jul 17 03:44:19 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:19 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e 1G" returned: 0 in 0.717s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64eab386-40dc-496f-9f7a-0383e2b65a22 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:19 devstack sudo[93422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64eab386-40dc-496f-9f7a-0383e2b65a22 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e
Jul 17 03:44:19 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:20 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.79445221-67e6-487a-9316-ed60a0fd5934" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-79445221-67e6-487a-9316-ed60a0fd5934" released by "_delete_snapshot" :: held 2.324s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" released by "delete_snapshot" :: held 2.374s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Created reservations ['efaa8de6-b856-4c83-8ed4-1938c0f1749c', '07a5ba68-8fa5-4d3c-b1f7-bbfbd1c89f18', 'b228dcf5-90bd-4722-a8f7-411998861836', 'b26634e0-e0d5-4a60-acb5-82b13bc2b1b8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Delete snapshot completed successfully.
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d9828f22-1646-423f-89d0-283717947525 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-79445221-67e6-487a-9316-ed60a0fd5934-delete_snapshot" released by "delete_snapshot" :: held 2.581s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:20 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64eab386-40dc-496f-9f7a-0383e2b65a22 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:20 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e is being set with open permissions: ugo+rw
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:20 devstack sudo[93434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e
Jul 17 03:44:20 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:20 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:20 devstack sudo[93438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.info
Jul 17 03:44:20 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-824dfe01-9a48-408a-b154-e39a47fd5b00-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-824dfe01-9a48-408a-b154-e39a47fd5b00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-quobyte-824dfe01-9a48-408a-b154-e39a47fd5b00" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-824dfe01-9a48-408a-b154-e39a47fd5b00" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Deleting offline snapshot 824dfe01-9a48-408a-b154-e39a47fd5b00 of volume 8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] snapshot_file for this snap is: volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac017f0-ac4d-4adc-9b8d-638f0c486fdc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:21 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.info" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:21 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.info is being set with open permissions: ugo+rw
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:21 devstack sudo[93442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.info
Jul 17 03:44:21 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:21 devstack sudo[93440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00
Jul 17 03:44:21 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:21 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.info" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.778s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.735s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1140946080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805cc1ca-b66a-4008-b45a-74c54b42c3f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33759e9dc8ac49f1960297b1682801f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:18Z,use_quota=True,user_id='4859c6be99b34cd0aff75e42ad4ef7f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:44:21 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Creating volume 805cc1ca-b66a-4008-b45a-74c54b42c3f7 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:44:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8af66e2c-791b-4ba0-b062-368edc14a0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:21 devstack sudo[93449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7 1073741824
Jul 17 03:44:21 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6860863b-8afb-4284-a52a-44d9122b2032]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a53cd958-c086-45b3-8e69-ff18af62ff25 tempest-SnapshotMetadataTestJSON-401793172 None] Create snapshot completed successfully
Jul 17 03:44:21 devstack sudo[93451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0
Jul 17 03:44:21 devstack sudo[93451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:21 devstack sudo[93451]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0" returned: 0 in 0.489s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:21 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7 1073741824" returned: 0 in 0.576s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:21 devstack sudo[93459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00
Jul 17 03:44:21 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:22 devstack sudo[93461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7
Jul 17 03:44:22 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:22 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3685faed-3885-4688-a6f3-d65508b0b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36750958-7b35-4bfe-a9e3-e122f0940a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Volume volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7 (805cc1ca-b66a-4008-b45a-74c54b42c3f7): created successfully
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36750958-7b35-4bfe-a9e3-e122f0940a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Flow 'volume_create_manager' (25330d0e-d4b9-499c-8975-e8501dcf8907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-07f075a2-f080-4f4f-8be5-91c8c5362a3c tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Created volume successfully.
Jul 17 03:44:22 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00" returned: 0 in 0.521s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:22 devstack sudo[93468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00
Jul 17 03:44:22 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "cinder-d1682858-1b93-4316-9827-50ec36c68c4e-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-d1682858-1b93-4316-9827-50ec36c68c4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "cinder-quobyte-64eab386-40dc-496f-9f7a-0383e2b65a22" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-quobyte-64eab386-40dc-496f-9f7a-0383e2b65a22" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "cinder-quobyte-d1682858-1b93-4316-9827-50ec36c68c4e" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-quobyte-d1682858-1b93-4316-9827-50ec36c68c4e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Deleting offline snapshot d1682858-1b93-4316-9827-50ec36c68c4e of volume 64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] snapshot_file for this snap is: volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db429c-e4b4-4967-8d3a-426c65a2c67d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:22 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0.824dfe01-9a48-408a-b154-e39a47fd5b00" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:22 devstack sudo[93470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e
Jul 17 03:44:22 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-824dfe01-9a48-408a-b154-e39a47fd5b00" released by "_delete_snapshot" :: held 1.864s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" released by "delete_snapshot" :: held 1.894s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Created reservations ['ae4077fc-d1d5-4065-ad66-f244f186f1f7', 'b4726cf2-a67e-4e98-91d8-7f700e5ec3f3', 'e8705ba8-f3f9-4705-8779-43de76d8feef', '41b7859e-c034-4998-b1a3-597c3e12adb6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Delete snapshot completed successfully.
Jul 17 03:44:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-331c0241-7aae-4edf-9077-8639ea718b3c tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-824dfe01-9a48-408a-b154-e39a47fd5b00-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:23 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64eab386-40dc-496f-9f7a-0383e2b65a22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc48bfc6-05ab-4279-bb93-40fc82b8152f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-8af66e2c-791b-4ba0-b062-368edc14a0a0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-8af66e2c-791b-4ba0-b062-368edc14a0a0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:23 devstack sudo[93476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22
Jul 17 03:44:23 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb524fd-cf0c-44e3-acfc-d5832d8bcc3c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:23 devstack sudo[93478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0
Jul 17 03:44:23 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:23 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:23 devstack sudo[93483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e
Jul 17 03:44:23 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:23 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:23 devstack sudo[93488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0
Jul 17 03:44:23 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:24 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:24 devstack sudo[93494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e
Jul 17 03:44:24 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:24 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Acquiring lock "cinder-805cc1ca-b66a-4008-b45a-74c54b42c3f7-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8af66e2c-791b-4ba0-b062-368edc14a0a0" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-quobyte-8af66e2c-791b-4ba0-b062-368edc14a0a0" released by "delete_volume" :: held 0.907s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "cinder-805cc1ca-b66a-4008-b45a-74c54b42c3f7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Acquiring lock "cinder-quobyte-805cc1ca-b66a-4008-b45a-74c54b42c3f7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "cinder-quobyte-805cc1ca-b66a-4008-b45a-74c54b42c3f7" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Created reservations ['d4996fe0-21fa-4f81-b644-825412df1c3c', '7d1e3426-9aa7-49c7-b66e-c0cb4a130466', '75c6fc63-e173-41bd-ae92-bd5de9a7a422', '9082e95f-8c53-46e5-bc90-7f4d13cc1e1b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[544eaccd-4e46-4c69-ac12-1b7195f1986c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:24 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22.d1682858-1b93-4316-9827-50ec36c68c4e" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-quobyte-d1682858-1b93-4316-9827-50ec36c68c4e" released by "_delete_snapshot" :: held 1.847s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-quobyte-64eab386-40dc-496f-9f7a-0383e2b65a22" released by "delete_snapshot" :: held 1.886s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:24 devstack sudo[93498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7
Jul 17 03:44:24 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:24 devstack sudo[93500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:24 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Created reservations ['0cfd6182-2dd7-4dd5-8479-93563696b6ee', '256c8bbd-4ce9-4577-b0a4-407df1503079', '924158e3-dbc1-4d8c-9d9c-b41282ff868b', '9142e304-83bb-4e73-bb10-896a0e7dd62c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Delete snapshot completed successfully.
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e71a8824-73ed-4e3d-90f4-02ae16eb2bb3 tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-d1682858-1b93-4316-9827-50ec36c68c4e-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:24 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7" returned: 0 in 0.443s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:24 devstack sudo[93505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "cinder-64eab386-40dc-496f-9f7a-0383e2b65a22-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:24 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:24 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-64eab386-40dc-496f-9f7a-0383e2b65a22-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Deleted volume successfully.
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "cinder-quobyte-64eab386-40dc-496f-9f7a-0383e2b65a22" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bf793cf4-bbe2-4e0d-b990-ae4afc314280 tempest-VolumesSnapshotListTestJSON-1175310433 None] Lock "cinder-8af66e2c-791b-4ba0-b062-368edc14a0a0-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-quobyte-64eab386-40dc-496f-9f7a-0383e2b65a22" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff24c06-cdf3-44aa-ab2d-2b49b2804cfb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:25 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-805cc1ca-b66a-4008-b45a-74c54b42c3f7" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:25 devstack sudo[93508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22
Jul 17 03:44:25 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "cinder-quobyte-805cc1ca-b66a-4008-b45a-74c54b42c3f7" released by "delete_volume" :: held 0.853s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Created reservations ['78eb6fa2-8c51-44c8-92c8-4497cd0ac7ad', 'e1ef5383-3df3-4c86-ade8-6db828a2467c', '6ef2e120-7c91-4064-abd8-049e24a46774', '22c08c87-83e4-4355-a5f9-0c90ef6dad83'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:25 devstack sudo[93511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:25 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:25 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:25 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22" returned: 0 in 0.630s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Deleted volume successfully.
Jul 17 03:44:25 devstack sudo[93518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22
Jul 17 03:44:25 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61d5f34-da57-49cc-863a-ecda8f5034c9 tempest-VolumeQuotasNegativeTestJSON-1126878551 None] Lock "cinder-805cc1ca-b66a-4008-b45a-74c54b42c3f7-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:25 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-64eab386-40dc-496f-9f7a-0383e2b65a22" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-quobyte-64eab386-40dc-496f-9f7a-0383e2b65a22" released by "delete_volume" :: held 1.069s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Created reservations ['52b3d281-a07e-40e2-9822-732c100036e9', '9e5ff687-5715-42dd-8daa-e97ac64f8356', 'ab23b6ca-91a2-47a1-acba-15578ce94345', '29897264-541f-448d-8f50-5b9c98788b72'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:26 devstack sudo[93521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:26 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:26 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Deleted volume successfully.
Jul 17 03:44:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d670775-8e75-4fac-96c8-d178a8b8cc1f tempest-SnapshotMetadataTestJSON-401793172 None] Lock "cinder-64eab386-40dc-496f-9f7a-0383e2b65a22-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Flow 'volume_create_manager' (4ee7800e-28f2-49ef-83a2-b854ea8d253d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c696e8ce-952f-4fa8-b31b-1de73f070465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c696e8ce-952f-4fa8-b31b-1de73f070465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1860813267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8af1de-cfab-4fca-b8ae-79cb77abdb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec8bcb71272420d800115796b4fdf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:36Z,use_quota=True,user_id='33b259c022884cf3a6f36fb149db7191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d51b3f-024b-4434-94a8-c8a0c90d2dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d51b3f-024b-4434-94a8-c8a0c90d2dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06ae648-847c-42fd-9d0c-3ce42c8868fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06ae648-847c-42fd-9d0c-3ce42c8868fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8af1de-cfab-4fca-b8ae-79cb77abdb29', 'volume_name': 'volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294b0c36-455b-4d40-90be-049729e089ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294b0c36-455b-4d40-90be-049729e089ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e792246a-b2e2-4ed6-bc33-81c8b26e69b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Volume 0d8af1de-cfab-4fca-b8ae-79cb77abdb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29', 'volume_size': 1}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1860813267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8af1de-cfab-4fca-b8ae-79cb77abdb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec8bcb71272420d800115796b4fdf29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:36Z,use_quota=True,user_id='33b259c022884cf3a6f36fb149db7191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Creating volume 0d8af1de-cfab-4fca-b8ae-79cb77abdb29 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:44:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:36 devstack sudo[93563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29 1073741824
Jul 17 03:44:36 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:36 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29 1073741824" returned: 0 in 0.580s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:36 devstack sudo[93570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29
Jul 17 03:44:36 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:36 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e792246a-b2e2-4ed6-bc33-81c8b26e69b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461d07ab-b261-41ac-b229-4e5e606bdb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Volume volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29 (0d8af1de-cfab-4fca-b8ae-79cb77abdb29): created successfully
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (461d07ab-b261-41ac-b229-4e5e606bdb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Flow 'volume_create_manager' (4ee7800e-28f2-49ef-83a2-b854ea8d253d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6d957843-8af3-48fb-b26a-2d2ccf77d3bf tempest-VolumesMetadataTest-324032131 None] Created volume successfully.
Jul 17 03:44:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Acquiring lock "cinder-0d8af1de-cfab-4fca-b8ae-79cb77abdb29-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Lock "cinder-0d8af1de-cfab-4fca-b8ae-79cb77abdb29-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Acquiring lock "cinder-quobyte-0d8af1de-cfab-4fca-b8ae-79cb77abdb29" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Lock "cinder-quobyte-0d8af1de-cfab-4fca-b8ae-79cb77abdb29" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8a2b25-64d6-40c4-bb42-ad434d447de8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:39 devstack sudo[93573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29
Jul 17 03:44:39 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:39 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29" returned: 0 in 0.592s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:39 devstack sudo[93578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29
Jul 17 03:44:39 devstack sudo[93578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:39 devstack sudo[93578]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d8af1de-cfab-4fca-b8ae-79cb77abdb29" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Lock "cinder-quobyte-0d8af1de-cfab-4fca-b8ae-79cb77abdb29" released by "delete_volume" :: held 0.967s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Created reservations ['45f8a09b-d3d0-4fa7-81ff-a4ca95abe93c', '4f42ba50-6b3e-4e0f-8b2c-e61bf00cc581', 'ec0e3866-f23a-4549-a499-9f5f1ec578db', '57ea6265-fe99-4d59-aba5-f7d1704e2bce'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:40 devstack sudo[93581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:40 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:40 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Deleted volume successfully.
Jul 17 03:44:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-797a7de5-6131-45f0-8da3-0cb69ca82740 tempest-VolumesMetadataTest-324032131 None] Lock "cinder-0d8af1de-cfab-4fca-b8ae-79cb77abdb29-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=88,cinder:INSERT=27,cinder:UPDATE=103,cinder:DELETE=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Flow 'volume_create_manager' (82f2fdc9-9071-4481-8510-605559dfe00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1830cb-d35d-4597-b4d5-f488377de742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1830cb-d35d-4597-b4d5-f488377de742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1040360553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d93c037-6ea4-4028-94da-2398519879a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45041ee20a994a33a0e817a9cf03e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:51Z,use_quota=True,user_id='c8481f0b21aa40ff9458eb6197930702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b2c526-f730-40bd-b974-95ba89414fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b2c526-f730-40bd-b974-95ba89414fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4cf82b-a169-4237-bf70-0332471cf670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c4cf82b-a169-4237-bf70-0332471cf670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d93c037-6ea4-4028-94da-2398519879a0', 'volume_name': 'volume-0d93c037-6ea4-4028-94da-2398519879a0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98ab802-3f30-4b00-a054-be57f0e651ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c98ab802-3f30-4b00-a054-be57f0e651ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e209f19-60a8-4ad4-a825-f541f3ac0d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Volume 0d93c037-6ea4-4028-94da-2398519879a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d93c037-6ea4-4028-94da-2398519879a0', 'volume_size': 1}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1040360553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d93c037-6ea4-4028-94da-2398519879a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45041ee20a994a33a0e817a9cf03e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:51Z,use_quota=True,user_id='c8481f0b21aa40ff9458eb6197930702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Creating volume 0d93c037-6ea4-4028-94da-2398519879a0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:44:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:44:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:50 devstack sudo[93592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0 1073741824
Jul 17 03:44:50 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:51 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0 1073741824" returned: 0 in 0.519s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:51 devstack sudo[93598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0
Jul 17 03:44:51 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:51 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e209f19-60a8-4ad4-a825-f541f3ac0d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d93c037-6ea4-4028-94da-2398519879a0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a1ce68-af4f-4e7e-9647-68b1e47e565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Volume volume-0d93c037-6ea4-4028-94da-2398519879a0 (0d93c037-6ea4-4028-94da-2398519879a0): created successfully
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a1ce68-af4f-4e7e-9647-68b1e47e565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Flow 'volume_create_manager' (82f2fdc9-9071-4481-8510-605559dfe00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4689f9f8-11ad-4fc4-904a-eab72831bded tempest-VolumesTransfersV357Test-147727046 None] Created volume successfully.
Jul 17 03:44:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-60912ec0-dfc7-447a-bba1-6dfa6e7fcf04 tempest-VolumesTransfersV357Test-323367078 None] Transfer volume completed successfully.
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Acquiring lock "cinder-0d93c037-6ea4-4028-94da-2398519879a0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-0d93c037-6ea4-4028-94da-2398519879a0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Acquiring lock "cinder-quobyte-0d93c037-6ea4-4028-94da-2398519879a0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-quobyte-0d93c037-6ea4-4028-94da-2398519879a0" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e750bad-a407-49d4-a18e-2515799afd4a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:54 devstack sudo[93601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0
Jul 17 03:44:54 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:54 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:54 devstack sudo[93606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0
Jul 17 03:44:54 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:55 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0d93c037-6ea4-4028-94da-2398519879a0" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-quobyte-0d93c037-6ea4-4028-94da-2398519879a0" released by "delete_volume" :: held 0.827s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=122,cinder:DELETE=10,cinder:SELECT=83,cinder:INSERT=32 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Created reservations ['479fe221-b582-4110-b515-24ba5f34e689', '75649575-a7d9-47a0-b5d8-5c641378efa7', '6992ad52-2c8a-40ee-8a16-9db2b30f03fe', '41aa08a7-549c-4629-842f-5638c5663461'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:55 devstack sudo[93610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:44:55 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:55 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:44:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Deleted volume successfully.
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9912d732-64ab-4cb8-b8c1-9083d6c2416a tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-0d93c037-6ea4-4028-94da-2398519879a0-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Flow 'volume_create_manager' (4ad78f13-1b7e-4ca9-a013-96cf28e801f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c846224d-ba36-44a0-b86d-01f9169a6a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c846224d-ba36-44a0-b86d-01f9169a6a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1490085121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45041ee20a994a33a0e817a9cf03e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:56Z,use_quota=True,user_id='c8481f0b21aa40ff9458eb6197930702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818d69f5-57b1-4f2c-abac-5572a8c21b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818d69f5-57b1-4f2c-abac-5572a8c21b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfcbf5e-7d6b-4b26-a540-b83bcdc5941a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dfcbf5e-7d6b-4b26-a540-b83bcdc5941a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df', 'volume_name': 'volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da675256-7e43-4496-b618-5707c3f211f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da675256-7e43-4496-b618-5707c3f211f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7add68-a4d0-4e12-b244-83dce1350854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Volume 0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df', 'volume_size': 1}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1490085121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45041ee20a994a33a0e817a9cf03e153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:44:56Z,use_quota=True,user_id='c8481f0b21aa40ff9458eb6197930702',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Creating volume 0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:44:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:44:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:56 devstack sudo[93613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df 1073741824
Jul 17 03:44:56 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:57 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df 1073741824" returned: 0 in 0.675s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:57 devstack sudo[93622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df
Jul 17 03:44:57 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:57 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7add68-a4d0-4e12-b244-83dce1350854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aadf5a7-fa12-4468-83a2-573837a6927b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:44:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Volume volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df (0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df): created successfully
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aadf5a7-fa12-4468-83a2-573837a6927b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:44:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Flow 'volume_create_manager' (4ad78f13-1b7e-4ca9-a013-96cf28e801f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:44:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5ba876b5-fdbb-4bed-8a6a-70f3869de25f tempest-VolumesTransfersV357Test-147727046 None] Created volume successfully.
Jul 17 03:44:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Acquiring lock "cinder-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Acquiring lock "cinder-quobyte-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:44:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-quobyte-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:44:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c052142a-6832-4be1-97f7-b5abab2c0b3a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:44:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:59 devstack sudo[93626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df
Jul 17 03:44:59 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:59 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:44:59 devstack sudo[93643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df
Jul 17 03:44:59 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:44:59 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root
Jul 17 03:44:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:44:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-quobyte-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df" released by "delete_volume" :: held 0.898s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:44:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Created reservations ['e91d2e37-4b38-4f7f-bf76-73f481547fb1', 'e4e38256-3f52-420f-a325-322aaf4b32b2', 'b51075d0-e0fa-4f87-992f-42a41b79ddf2', 'f896366b-9536-4edf-89c5-d5c6822eef11'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:00 devstack sudo[93653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:45:00 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:00 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:45:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Deleted volume successfully.
Jul 17 03:45:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0c80b3f-0174-4089-9f54-03fe287a1e20 tempest-VolumesTransfersV357Test-472464334 None] Lock "cinder-0ecf40e2-fbdc-42cb-8bdb-f5a0ef0062df-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Flow 'volume_create_manager' (9442c57d-2bf2-46d5-ab9a-3be0b0c17a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17765b83-ec7f-4013-819f-f16720622a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17765b83-ec7f-4013-819f-f16720622a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1429188809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65299a4e-2402-4ed6-aa26-3d6d832401e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72808b01b8294e5798305d5f7a42a14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:01Z,use_quota=True,user_id='44d5fc29ff5248f897d0e281a039bde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9066eda0-ab47-46ab-833c-d90c0a41540a),volume_type_id=9066eda0-ab47-46ab-833c-d90c0a41540a)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9931d9be-d13c-479c-acf0-3824e9c9bd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9931d9be-d13c-479c-acf0-3824e9c9bd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b3a0cb-191d-43ac-9d2a-9d0c67b9b348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5b3a0cb-191d-43ac-9d2a-9d0c67b9b348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65299a4e-2402-4ed6-aa26-3d6d832401e5', 'volume_name': 'volume-65299a4e-2402-4ed6-aa26-3d6d832401e5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb7d9e5-ee21-4d96-8482-30e0a3ec46a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb7d9e5-ee21-4d96-8482-30e0a3ec46a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e9d166-497e-4dcd-abee-dcc1d5af242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Volume 65299a4e-2402-4ed6-aa26-3d6d832401e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65299a4e-2402-4ed6-aa26-3d6d832401e5', 'volume_size': 1}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1429188809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65299a4e-2402-4ed6-aa26-3d6d832401e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72808b01b8294e5798305d5f7a42a14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:01Z,use_quota=True,user_id='44d5fc29ff5248f897d0e281a039bde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9066eda0-ab47-46ab-833c-d90c0a41540a),volume_type_id=9066eda0-ab47-46ab-833c-d90c0a41540a)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Creating volume 65299a4e-2402-4ed6-aa26-3d6d832401e5 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:01 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:01 devstack sudo[93656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5 1073741824
Jul 17 03:45:01 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Flow 'volume_create_manager' (a7f66bd3-159e-4a47-8562-a96025268e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69db9cf8-b9ee-41e7-95e9-32dfccc5752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69db9cf8-b9ee-41e7-95e9-32dfccc5752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447578352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1b345-54cd-4e30-a99d-43f7af828455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72808b01b8294e5798305d5f7a42a14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:02Z,use_quota=True,user_id='44d5fc29ff5248f897d0e281a039bde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e84fb52-6c63-4d13-8168-ee118527cc69),volume_type_id=3e84fb52-6c63-4d13-8168-ee118527cc69)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebd7356-aaa9-403c-83b2-5e60561f33e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ebd7356-aaa9-403c-83b2-5e60561f33e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8318bc5-923a-46ef-b988-d2b72c664d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8318bc5-923a-46ef-b988-d2b72c664d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf1b345-54cd-4e30-a99d-43f7af828455', 'volume_name': 'volume-2bf1b345-54cd-4e30-a99d-43f7af828455', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f915c2c-6ec4-4321-a7e5-e92162ff3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f915c2c-6ec4-4321-a7e5-e92162ff3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31953f6-eeb8-4b59-b99c-07fff1da074c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Volume 2bf1b345-54cd-4e30-a99d-43f7af828455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf1b345-54cd-4e30-a99d-43f7af828455', 'volume_size': 1}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:02 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5 1073741824" returned: 0 in 0.794s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:02 devstack sudo[93667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5
Jul 17 03:45:02 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:02 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-447578352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1b345-54cd-4e30-a99d-43f7af828455,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72808b01b8294e5798305d5f7a42a14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:02Z,use_quota=True,user_id='44d5fc29ff5248f897d0e281a039bde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e84fb52-6c63-4d13-8168-ee118527cc69),volume_type_id=3e84fb52-6c63-4d13-8168-ee118527cc69)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Creating volume 2bf1b345-54cd-4e30-a99d-43f7af828455 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:02 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e9d166-497e-4dcd-abee-dcc1d5af242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65299a4e-2402-4ed6-aa26-3d6d832401e5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:02 devstack sudo[93670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455 1073741824
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f4c6e9-4ea0-492c-8cce-978b88e8effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:02 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Volume volume-65299a4e-2402-4ed6-aa26-3d6d832401e5 (65299a4e-2402-4ed6-aa26-3d6d832401e5): created successfully
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f4c6e9-4ea0-492c-8cce-978b88e8effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Flow 'volume_create_manager' (9442c57d-2bf2-46d5-ab9a-3be0b0c17a90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4f3b3510-2eee-48da-8d7f-f4434ce636c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Created volume successfully.
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Flow 'volume_create_manager' (86a1f07a-49e7-44eb-bbef-66937ad02a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a1a948-3ef2-428a-99c5-ca955b3c22f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:03 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455 1073741824" returned: 0 in 0.773s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44a1a948-3ef2-428a-99c5-ca955b3c22f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-797696842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c975383f-34f5-44f1-a2be-816d733b5eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72808b01b8294e5798305d5f7a42a14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:03Z,use_quota=True,user_id='44d5fc29ff5248f897d0e281a039bde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1e1455c-2280-4b08-8dfe-f66ab2e881d6),volume_type_id=b1e1455c-2280-4b08-8dfe-f66ab2e881d6)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ca2e2c-e273-466e-84e0-6c1697fd4dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1ca2e2c-e273-466e-84e0-6c1697fd4dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3d053f-86e8-45c6-8838-d50b906544ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:03 devstack sudo[93678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455
Jul 17 03:45:03 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:03 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3d053f-86e8-45c6-8838-d50b906544ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c975383f-34f5-44f1-a2be-816d733b5eb9', 'volume_name': 'volume-c975383f-34f5-44f1-a2be-816d733b5eb9', 'volume_size': 1, 'image_id': 'ca4b0984-2262-465e-8c54-8d6b279516c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca4b0984-2262-465e-8c54-8d6b279516c7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--106990932', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72808b01b8294e5798305d5f7a42a14b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca4b0984-2262-465e-8c54-8d6b279516c7', 'created_at': datetime.datetime(2026, 7, 17, 1, 44, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca4b0984-2262-465e-8c54-8d6b279516c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf832c0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7251bf-d892-48a6-a395-62f2356452f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7251bf-d892-48a6-a395-62f2356452f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d285d59f-4634-4219-bae3-db714ea97fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Volume c975383f-34f5-44f1-a2be-816d733b5eb9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c975383f-34f5-44f1-a2be-816d733b5eb9', 'volume_size': 1, 'image_id': 'ca4b0984-2262-465e-8c54-8d6b279516c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca4b0984-2262-465e-8c54-8d6b279516c7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--106990932', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72808b01b8294e5798305d5f7a42a14b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca4b0984-2262-465e-8c54-8d6b279516c7', 'created_at': datetime.datetime(2026, 7, 17, 1, 44, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca4b0984-2262-465e-8c54-8d6b279516c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf832c0>}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Trying to clone c975383f-34f5-44f1-a2be-816d733b5eb9 from image ca4b0984-2262-465e-8c54-8d6b279516c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca4b0984-2262-465e-8c54-8d6b279516c7', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455" returned: 0 in 0.454s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31953f6-eeb8-4b59-b99c-07fff1da074c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf1b345-54cd-4e30-a99d-43f7af828455', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024c6e02-715d-4258-878d-67f7bf862dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Volume volume-2bf1b345-54cd-4e30-a99d-43f7af828455 (2bf1b345-54cd-4e30-a99d-43f7af828455): created successfully
Jul 17 03:45:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024c6e02-715d-4258-878d-67f7bf862dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Flow 'volume_create_manager' (a7f66bd3-159e-4a47-8562-a96025268e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-42ad7ea5-f214-4172-9bb3-b59978df9bb8 tempest-TestInstancesWithCinderVolumes-561002478 None] Created volume successfully.
Jul 17 03:45:10 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD, size 20.69 MB, duration 6.07 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 03:45:10 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Image download 20.69 MB at 3.41 MB/s
Jul 17 03:45:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c13eb2c-92f6-4481-b494-7c1a7467e580]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:45:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:10 devstack sudo[93753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD
Jul 17 03:45:10 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:11 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD" returned: 0 in 1.022s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Temporary image ca4b0984-2262-465e-8c54-8d6b279516c7 is fetched for user 44d5fc29ff5248f897d0e281a039bde1. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fa628f-ccfe-4568-8dd1-61eb0a91c797]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:11 devstack sudo[93758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD
Jul 17 03:45:11 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:11 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-797696842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c975383f-34f5-44f1-a2be-816d733b5eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72808b01b8294e5798305d5f7a42a14b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:03Z,use_quota=True,user_id='44d5fc29ff5248f897d0e281a039bde1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1e1455c-2280-4b08-8dfe-f66ab2e881d6),volume_type_id=b1e1455c-2280-4b08-8dfe-f66ab2e881d6)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Creating volume c975383f-34f5-44f1-a2be-816d733b5eb9 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:11 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:11 devstack sudo[93765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 1073741824
Jul 17 03:45:11 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:12 devstack sudo[93771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:45:12 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:12 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 1073741824" returned: 0 in 0.751s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:12 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:45:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:12 devstack sudo[93774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9
Jul 17 03:45:12 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:13 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Attempting download of ca4b0984-2262-465e-8c54-8d6b279516c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca4b0984-2262-465e-8c54-8d6b279516c7', 'metadata': {}}])) to volume c975383f-34f5-44f1-a2be-816d733b5eb9. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d019f-4165-4cf9-be8c-934503efdf4e]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca4b0984-2262-465e-8c54-8d6b279516c7_frgxwfwe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:13 devstack sudo[93777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca4b0984-2262-465e-8c54-8d6b279516c7_frgxwfwe
Jul 17 03:45:13 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:13 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca4b0984-2262-465e-8c54-8d6b279516c7_frgxwfwe" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4b0984-2262-465e-8c54-8d6b279516c7_frgxwfwe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:13 devstack sudo[93781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4b0984-2262-465e-8c54-8d6b279516c7_frgxwfwe
Jul 17 03:45:13 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:14 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4b0984-2262-465e-8c54-8d6b279516c7_frgxwfwe" returned: 1 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca4b0984-2262-465e-8c54-8d6b279516c7_frgxwfwe' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:45:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbaecdf-3613-4fd2-8144-777a8c72d660]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:45:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:14 devstack sudo[93785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD
Jul 17 03:45:14 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:14 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:14 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] ca4b0984-2262-465e-8c54-8d6b279516c7 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 03:45:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:14 devstack sudo[93791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9
Jul 17 03:45:14 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:16 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9" returned: 0 in 2.227s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:16 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca4b0984-2262-465e-8c54-8d6b279516c7_3_qsnfq1devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:45:16 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Converted 112.00 MB image at 50.24 MB/s
Jul 17 03:45:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:16 devstack sudo[93800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 1G
Jul 17 03:45:16 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:17 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 1G" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Downloaded image ca4b0984-2262-465e-8c54-8d6b279516c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca4b0984-2262-465e-8c54-8d6b279516c7', 'metadata': {}}])) to volume c975383f-34f5-44f1-a2be-816d733b5eb9 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Temporary image ca4b0984-2262-465e-8c54-8d6b279516c7 for user 44d5fc29ff5248f897d0e281a039bde1 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Marking volume c975383f-34f5-44f1-a2be-816d733b5eb9 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Copying metadata from image ca4b0984-2262-465e-8c54-8d6b279516c7 to c975383f-34f5-44f1-a2be-816d733b5eb9. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Creating volume glance metadata for volume c975383f-34f5-44f1-a2be-816d733b5eb9 backed by image ca4b0984-2262-465e-8c54-8d6b279516c7 with: {'image_id': 'ca4b0984-2262-465e-8c54-8d6b279516c7', 'image_name': 'tempest-scenario-img--106990932', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d285d59f-4634-4219-bae3-db714ea97fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c975383f-34f5-44f1-a2be-816d733b5eb9', 'volume_size': 1, 'image_id': 'ca4b0984-2262-465e-8c54-8d6b279516c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca4b0984-2262-465e-8c54-8d6b279516c7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--106990932', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72808b01b8294e5798305d5f7a42a14b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca4b0984-2262-465e-8c54-8d6b279516c7', 'created_at': datetime.datetime(2026, 7, 17, 1, 44, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca4b0984-2262-465e-8c54-8d6b279516c7/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf832c0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68021e97-ff9a-47b7-b20e-0f9e1e084848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Volume volume-c975383f-34f5-44f1-a2be-816d733b5eb9 (c975383f-34f5-44f1-a2be-816d733b5eb9): created successfully
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68021e97-ff9a-47b7-b20e-0f9e1e084848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Flow 'volume_create_manager' (86a1f07a-49e7-44eb-bbef-66937ad02a79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-86c677c8-7d04-44f7-a08b-022fdce38aea tempest-TestInstancesWithCinderVolumes-561002478 None] Created volume successfully.
Jul 17 03:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ba9b7d47-3a0d-4f3d-95bb-24e4d5a8f183 req-ab561d23-e753-4280-bd29-8a14cec40d06 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ba9b7d47-3a0d-4f3d-95bb-24e4d5a8f183 req-ab561d23-e753-4280-bd29-8a14cec40d06 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ba9b7d47-3a0d-4f3d-95bb-24e4d5a8f183 req-ab561d23-e753-4280-bd29-8a14cec40d06 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-ba9b7d47-3a0d-4f3d-95bb-24e4d5a8f183 req-ab561d23-e753-4280-bd29-8a14cec40d06 tempest-TestInstancesWithCinderVolumes-561002478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-c975383f-34f5-44f1-a2be-816d733b5eb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61e5374c-1c56-4c94-a346-a17f8850bf3b', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:45:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-ba9b7d47-3a0d-4f3d-95bb-24e4d5a8f183 req-ab561d23-e753-4280-bd29-8a14cec40d06 tempest-TestInstancesWithCinderVolumes-561002478 None] attachment_update completed successfully.
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Flow 'volume_create_manager' (aaacfcee-6c91-409f-ae88-38a7af119ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70f5612-24c7-4bac-9138-185a4fcdf04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70f5612-24c7-4bac-9138-185a4fcdf04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1895247439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bb9aca-421d-4d6d-90c0-916cdb51ab46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c6cc6dc92747488bf02c63ab76b34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:33Z,use_quota=True,user_id='78ea951c89814f989b05b2dbf47ce3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01007f14-a969-4bc2-a0e2-158d1fe8b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01007f14-a969-4bc2-a0e2-158d1fe8b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b83023e-fa5c-4c8d-b2c8-f62cc5df32dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b83023e-fa5c-4c8d-b2c8-f62cc5df32dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bb9aca-421d-4d6d-90c0-916cdb51ab46', 'volume_name': 'volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd87ce06-e250-448f-bbd8-dc1599f9b0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd87ce06-e250-448f-bbd8-dc1599f9b0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfc25c8-db56-4fe5-b3f9-3d120284b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Volume c0bb9aca-421d-4d6d-90c0-916cdb51ab46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46', 'volume_size': 1}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1895247439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bb9aca-421d-4d6d-90c0-916cdb51ab46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c6cc6dc92747488bf02c63ab76b34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:33Z,use_quota=True,user_id='78ea951c89814f989b05b2dbf47ce3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Creating volume c0bb9aca-421d-4d6d-90c0-916cdb51ab46 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:33 devstack sudo[94409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46 1073741824
Jul 17 03:45:33 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:34 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46 1073741824" returned: 0 in 0.685s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:34 devstack sudo[94416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46
Jul 17 03:45:34 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:34 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bfc25c8-db56-4fe5-b3f9-3d120284b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4006852-a7f4-4879-a09b-6ffd56b35ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Volume volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46 (c0bb9aca-421d-4d6d-90c0-916cdb51ab46): created successfully
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4006852-a7f4-4879-a09b-6ffd56b35ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Flow 'volume_create_manager' (aaacfcee-6c91-409f-ae88-38a7af119ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-00e57da5-7889-49b7-8801-2dc83ef1fafa tempest-AttachVolumeTestJSON-153690705 None] Created volume successfully.
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Flow 'volume_create_manager' (323201ef-c3d6-4e08-9068-0ef3d577b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62250742-6314-4c91-bae0-3d563f8df3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62250742-6314-4c91-bae0-3d563f8df3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270014879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadd8931-f04a-4a22-9f04-e026e11d87ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d174d74344f4c05b39f6e8dad9ce2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:37Z,use_quota=True,user_id='66530bbeba274186b8b5b71f839ae4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e292b1b2-0ca1-4b69-b964-bef5781fcedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e292b1b2-0ca1-4b69-b964-bef5781fcedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83656dd-d4e9-4061-bf56-95a883146708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83656dd-d4e9-4061-bf56-95a883146708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cadd8931-f04a-4a22-9f04-e026e11d87ec', 'volume_name': 'volume-cadd8931-f04a-4a22-9f04-e026e11d87ec', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30258c73-da6c-4f91-9dd3-eb63d544e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30258c73-da6c-4f91-9dd3-eb63d544e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d889ef31-8ad4-4afb-8407-fb1a7e32a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Volume cadd8931-f04a-4a22-9f04-e026e11d87ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cadd8931-f04a-4a22-9f04-e026e11d87ec', 'volume_size': 1}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270014879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadd8931-f04a-4a22-9f04-e026e11d87ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d174d74344f4c05b39f6e8dad9ce2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:37Z,use_quota=True,user_id='66530bbeba274186b8b5b71f839ae4c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Creating volume cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:37 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec 1073741824
Jul 17 03:45:37 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (465ca2cd-4f1b-4ad2-bef4-ce25724ec790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa858523-7141-46d5-b9d2-0f762e030a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa858523-7141-46d5-b9d2-0f762e030a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790160618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1e5632-52eb-4c22-83c1-8007ec9b2bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:37Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d057aa9-886f-4114-8fce-cd0155dcaac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d057aa9-886f-4114-8fce-cd0155dcaac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca8ff96-dd96-4a56-ad27-212961901de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca8ff96-dd96-4a56-ad27-212961901de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1e5632-52eb-4c22-83c1-8007ec9b2bb3', 'volume_name': 'volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b3b33c-6f72-43b8-88ec-15023bc712f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b3b33c-6f72-43b8-88ec-15023bc712f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62be731b-78e9-4b64-b0fa-83be27d4337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Volume 1d1e5632-52eb-4c22-83c1-8007ec9b2bb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3', 'volume_size': 1}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b86bf9fb-fd7f-4217-881f-ac85ebe0f181 req-11ae3f36-c60d-40df-abb9-289d893a42c5 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:37 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec 1073741824" returned: 0 in 0.972s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:38 devstack sudo[94443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:45:38 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:38 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.103s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790160618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1e5632-52eb-4c22-83c1-8007ec9b2bb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:37Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Creating volume 1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d889ef31-8ad4-4afb-8407-fb1a7e32a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cadd8931-f04a-4a22-9f04-e026e11d87ec', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60d5a55-bd16-4964-b283-77565c49a296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:38 devstack sudo[94446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 1073741824
Jul 17 03:45:38 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Volume volume-cadd8931-f04a-4a22-9f04-e026e11d87ec (cadd8931-f04a-4a22-9f04-e026e11d87ec): created successfully
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60d5a55-bd16-4964-b283-77565c49a296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Flow 'volume_create_manager' (323201ef-c3d6-4e08-9068-0ef3d577b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7945b212-47e0-437e-bf86-d0b77a5496f3 tempest-VolumesActionsTest-961347983 None] Created volume successfully.
Jul 17 03:45:38 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 1073741824" returned: 0 in 0.539s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:38 devstack sudo[94452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3
Jul 17 03:45:38 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:39 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b86bf9fb-fd7f-4217-881f-ac85ebe0f181 req-11ae3f36-c60d-40df-abb9-289d893a42c5 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.706s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62be731b-78e9-4b64-b0fa-83be27d4337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aae0f5-a1fb-4383-9b0b-4485aa976b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b86bf9fb-fd7f-4217-881f-ac85ebe0f181 req-11ae3f36-c60d-40df-abb9-289d893a42c5 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Volume volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 (1d1e5632-52eb-4c22-83c1-8007ec9b2bb3): created successfully
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3aae0f5-a1fb-4383-9b0b-4485aa976b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (465ca2cd-4f1b-4ad2-bef4-ce25724ec790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a751aefd-c2f2-4fc5-8942-dc87ee763ae9 tempest-VolumesActionsTest-1239271041 None] Created volume successfully.
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-b86bf9fb-fd7f-4217-881f-ac85ebe0f181 req-11ae3f36-c60d-40df-abb9-289d893a42c5 tempest-AttachVolumeTestJSON-153690705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2e3e30e-a266-4177-969f-d17bdd088e30', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:45:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-b86bf9fb-fd7f-4217-881f-ac85ebe0f181 req-11ae3f36-c60d-40df-abb9-289d893a42c5 tempest-AttachVolumeTestJSON-153690705 None] attachment_update completed successfully.
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d02bd500-2508-4405-8c2d-feca422997a1 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d02bd500-2508-4405-8c2d-feca422997a1 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" acquired by "attach_volume" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d02bd500-2508-4405-8c2d-feca422997a1 tempest-VolumesActionsTest-1239271041 None] Attaching volume 1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 to instance efd9a46d-f816-4047-8611-8855ec1a13e6 at mountpoint /dev/vdb on host None.
Jul 17 03:45:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d02bd500-2508-4405-8c2d-feca422997a1 tempest-VolumesActionsTest-1239271041 None] Attach volume completed successfully.
Jul 17 03:45:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d02bd500-2508-4405-8c2d-feca422997a1 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" released by "attach_volume" :: held 0.282s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b219078f-6730-4f36-b11a-ece16f8190cc tempest-VolumesActionsTest-1548850973 None] Terminate volume connection completed successfully.
Jul 17 03:45:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b219078f-6730-4f36-b11a-ece16f8190cc tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b219078f-6730-4f36-b11a-ece16f8190cc tempest-VolumesActionsTest-1548850973 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b219078f-6730-4f36-b11a-ece16f8190cc tempest-VolumesActionsTest-1548850973 None] Detaching volume 1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 from instance efd9a46d-f816-4047-8611-8855ec1a13e6.
Jul 17 03:45:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b219078f-6730-4f36-b11a-ece16f8190cc tempest-VolumesActionsTest-1548850973 None] Detach volume completed successfully.
Jul 17 03:45:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b219078f-6730-4f36-b11a-ece16f8190cc tempest-VolumesActionsTest-1548850973 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-detach_volume" released by "detach_volume" :: held 0.184s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b2953950-ee0c-4eaf-a787-8ec777660a16 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b2953950-ee0c-4eaf-a787-8ec777660a16 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b2953950-ee0c-4eaf-a787-8ec777660a16 tempest-VolumesActionsTest-1239271041 None] Volume detach called, but volume not attached.
Jul 17 03:45:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b2953950-ee0c-4eaf-a787-8ec777660a16 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Acquiring lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Acquiring lock "cinder-quobyte-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Lock "cinder-quobyte-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba9d2f-7d61-423a-9f68-fbf5647734f6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:45:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:43 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3
Jul 17 03:45:43 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:44 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" returned: 0 in 0.684s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:44 devstack sudo[94476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3
Jul 17 03:45:44 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:44 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" returned: 0 in 0.464s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Lock "cinder-quobyte-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3" released by "delete_volume" :: held 1.311s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Created reservations ['d60a1c6d-cc25-4be7-9d96-2a5555b34508', 'c1a1b417-536b-4176-87eb-c293096684b8', '07441f28-cffa-4d9e-8cd0-d5e4533fc605', '9d592826-430a-4cc7-afd7-91176f28e090'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:45 devstack sudo[94493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:45:45 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:45 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.636s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:45:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Deleted volume successfully.
Jul 17 03:45:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-81e16f52-9bce-4da0-bdc9-d20a767db11c tempest-VolumesActionsTest-1239271041 None] Lock "cinder-1d1e5632-52eb-4c22-83c1-8007ec9b2bb3-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:53 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=61,cinder:SELECT=54,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:45:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (b3bdcb63-602a-4f0b-ae00-7d92c2e6da65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ae841e-f445-43b0-bcef-fed35220a91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ae841e-f445-43b0-bcef-fed35220a91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-708168283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86014eba-549a-4f97-866f-75592ccce52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:54Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e4059-abed-44a3-8c3b-42315d2f0652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6e4059-abed-44a3-8c3b-42315d2f0652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3abc65-6bbf-4ae1-a0b5-3168784b14d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da3abc65-6bbf-4ae1-a0b5-3168784b14d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86014eba-549a-4f97-866f-75592ccce52c', 'volume_name': 'volume-86014eba-549a-4f97-866f-75592ccce52c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23c704d-ae5c-4c53-ab61-ebc8d23ba8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23c704d-ae5c-4c53-ab61-ebc8d23ba8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f465e8-27d6-4bd7-8f54-ca30ecc5b2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Volume 86014eba-549a-4f97-866f-75592ccce52c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86014eba-549a-4f97-866f-75592ccce52c', 'volume_size': 1}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-708168283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86014eba-549a-4f97-866f-75592ccce52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:45:54Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Creating volume 86014eba-549a-4f97-866f-75592ccce52c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:54 devstack sudo[94706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c 1073741824
Jul 17 03:45:54 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:55 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c 1073741824" returned: 0 in 1.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:55 devstack sudo[94733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c
Jul 17 03:45:55 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:55 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c" returned: 0 in 0.570s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:45:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:55 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:INSERT=19,cinder:UPDATE=51,cinder:SELECT=59,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f465e8-27d6-4bd7-8f54-ca30ecc5b2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86014eba-549a-4f97-866f-75592ccce52c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd62ba5d-d8bb-4c1e-bac4-1c9fe6d0e90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Volume volume-86014eba-549a-4f97-866f-75592ccce52c (86014eba-549a-4f97-866f-75592ccce52c): created successfully
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd62ba5d-d8bb-4c1e-bac4-1c9fe6d0e90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (b3bdcb63-602a-4f0b-ae00-7d92c2e6da65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d11d607e-2f3a-4c91-affd-46f11c473412 tempest-VolumesActionsTest-1239271041 None] Created volume successfully.
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-86014eba-549a-4f97-866f-75592ccce52c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-86014eba-549a-4f97-866f-75592ccce52c-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-quobyte-86014eba-549a-4f97-866f-75592ccce52c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-86014eba-549a-4f97-866f-75592ccce52c" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd5f2ee-64b9-49eb-b909-4127a2c8fe8e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:45:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:56 devstack sudo[94748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c
Jul 17 03:45:56 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fe164a-7a21-459e-9999-d8affc67ff03 tempest-VolumesActionsTest-961347983 None] Acquiring lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:57 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c" returned: 0 in 0.590s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fe164a-7a21-459e-9999-d8affc67ff03 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec" acquired by "attach_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:57 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c
Jul 17 03:45:57 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-68fe164a-7a21-459e-9999-d8affc67ff03 tempest-VolumesActionsTest-961347983 None] Attaching volume cadd8931-f04a-4a22-9f04-e026e11d87ec to instance f4d67dd1-9bf9-4f08-87a0-9b9cc272f07d at mountpoint /dev/vdb on host None.
Jul 17 03:45:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-68fe164a-7a21-459e-9999-d8affc67ff03 tempest-VolumesActionsTest-961347983 None] Attach volume completed successfully.
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fe164a-7a21-459e-9999-d8affc67ff03 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec" released by "attach_volume" :: held 0.120s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1bf63c8b-5677-4434-90a0-cd0a5a84ab96 tempest-VolumesActionsTest-961347983 None] Acquiring lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:45:57 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-86014eba-549a-4f97-866f-75592ccce52c" returned: 0 in 0.388s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1bf63c8b-5677-4434-90a0-cd0a5a84ab96 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:45:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1bf63c8b-5677-4434-90a0-cd0a5a84ab96 tempest-VolumesActionsTest-961347983 None] Detaching volume cadd8931-f04a-4a22-9f04-e026e11d87ec from instance f4d67dd1-9bf9-4f08-87a0-9b9cc272f07d.
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-86014eba-549a-4f97-866f-75592ccce52c" released by "delete_volume" :: held 1.059s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Created reservations ['c452bbe5-bfcb-483b-98f5-c2155f33303e', '54bd91f1-7653-4920-8364-a56a6575a66a', 'e592288f-5379-43d5-95b2-f088f2a976ac', '0647d465-f87a-4512-93ce-7d9d2979e4ad'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:45:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1bf63c8b-5677-4434-90a0-cd0a5a84ab96 tempest-VolumesActionsTest-961347983 None] Detach volume completed successfully.
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1bf63c8b-5677-4434-90a0-cd0a5a84ab96 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:58 devstack sudo[94757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:45:58 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:45:58 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root
Jul 17 03:45:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:45:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:45:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Deleted volume successfully.
Jul 17 03:45:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-19bbeb9b-0b12-469d-9a63-deeb03c84c13 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-86014eba-549a-4f97-866f-75592ccce52c-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (2c43a245-52b5-448f-86dc-e5b5c2018298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87961a7a-99dc-4d16-90d2-f961ef54f91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87961a7a-99dc-4d16-90d2-f961ef54f91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-964479673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70647252-bc5e-4d73-ba99-bad51f415c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:00Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e773ad5a-2ea2-4091-a1f4-4f5f0d9ac56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e773ad5a-2ea2-4091-a1f4-4f5f0d9ac56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074f9b1c-5919-4eed-bdd1-1c65339f7211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074f9b1c-5919-4eed-bdd1-1c65339f7211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70647252-bc5e-4d73-ba99-bad51f415c61', 'volume_name': 'volume-70647252-bc5e-4d73-ba99-bad51f415c61', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66361e8-36bc-48f3-89df-5714a1aeea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66361e8-36bc-48f3-89df-5714a1aeea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f771e-ad2e-4a44-ab2b-1ed9004b637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:45:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Volume 70647252-bc5e-4d73-ba99-bad51f415c61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70647252-bc5e-4d73-ba99-bad51f415c61', 'volume_size': 1}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-964479673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70647252-bc5e-4d73-ba99-bad51f415c61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:00Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Creating volume 70647252-bc5e-4d73-ba99-bad51f415c61 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:45:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:45:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:45:59 devstack sudo[94783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61 1073741824
Jul 17 03:45:59 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:00 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61 1073741824" returned: 0 in 0.545s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:00 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61
Jul 17 03:46:00 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:00 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd6f771e-ad2e-4a44-ab2b-1ed9004b637a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70647252-bc5e-4d73-ba99-bad51f415c61', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0809a17e-e4d8-427d-9d14-128210110da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Volume volume-70647252-bc5e-4d73-ba99-bad51f415c61 (70647252-bc5e-4d73-ba99-bad51f415c61): created successfully
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0809a17e-e4d8-427d-9d14-128210110da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (2c43a245-52b5-448f-86dc-e5b5c2018298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-76320b51-cb7f-420d-a64a-8f2697294257 tempest-VolumesActionsTest-1239271041 None] Created volume successfully.
Jul 17 03:46:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-70647252-bc5e-4d73-ba99-bad51f415c61-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-70647252-bc5e-4d73-ba99-bad51f415c61-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-quobyte-70647252-bc5e-4d73-ba99-bad51f415c61" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-70647252-bc5e-4d73-ba99-bad51f415c61" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6cd837-2384-4db9-88b5-18dbf0c47c5c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:02 devstack sudo[94796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61
Jul 17 03:46:02 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:02 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:02 devstack sudo[94803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61
Jul 17 03:46:02 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:02 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-70647252-bc5e-4d73-ba99-bad51f415c61" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-70647252-bc5e-4d73-ba99-bad51f415c61" released by "delete_volume" :: held 0.761s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Created reservations ['6c7f13b3-75bb-462d-8227-cf10d445b941', '608b385d-ca1c-4814-9618-0e5ceb845b1b', '580750f2-4db8-4039-ab0d-362363a883f6', 'd3406ce4-b1e5-4c20-a9bd-03c26a123408'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:03 devstack sudo[94806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:03 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:03 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.487s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Deleted volume successfully.
Jul 17 03:46:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2671abf4-fe8d-4a21-9650-74ae9a52a073 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-70647252-bc5e-4d73-ba99-bad51f415c61-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (1615115b-1e2c-403a-bb25-f3d2079557aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2718a49f-8074-4648-bb56-1182a2dd7cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2718a49f-8074-4648-bb56-1182a2dd7cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-872499212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472aca8a-4fec-413d-9238-58223b787b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:04Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8b52e3-bd79-4b26-9571-ce45467a404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8b52e3-bd79-4b26-9571-ce45467a404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38367606-b4e4-4052-8f9e-3cdcc3e9b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38367606-b4e4-4052-8f9e-3cdcc3e9b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '472aca8a-4fec-413d-9238-58223b787b69', 'volume_name': 'volume-472aca8a-4fec-413d-9238-58223b787b69', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426e44eb-6360-4185-8311-60b9f471327d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (426e44eb-6360-4185-8311-60b9f471327d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165bd9d6-d501-4fe1-b993-9c931944c9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Volume 472aca8a-4fec-413d-9238-58223b787b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-472aca8a-4fec-413d-9238-58223b787b69', 'volume_size': 1}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-872499212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=472aca8a-4fec-413d-9238-58223b787b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:04Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Creating volume 472aca8a-4fec-413d-9238-58223b787b69 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:46:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:04 devstack sudo[94823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69 1073741824
Jul 17 03:46:04 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:04 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69 1073741824" returned: 0 in 0.840s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:05 devstack sudo[94835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69
Jul 17 03:46:05 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:05 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (165bd9d6-d501-4fe1-b993-9c931944c9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-472aca8a-4fec-413d-9238-58223b787b69', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ab31ff-94ca-4afa-8b58-91ba72754c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Volume volume-472aca8a-4fec-413d-9238-58223b787b69 (472aca8a-4fec-413d-9238-58223b787b69): created successfully
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ab31ff-94ca-4afa-8b58-91ba72754c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (1615115b-1e2c-403a-bb25-f3d2079557aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f91327ef-cd3e-4460-9c46-cb15f71b2690 tempest-VolumesActionsTest-1239271041 None] Created volume successfully.
Jul 17 03:46:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-472aca8a-4fec-413d-9238-58223b787b69-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-472aca8a-4fec-413d-9238-58223b787b69-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-quobyte-472aca8a-4fec-413d-9238-58223b787b69" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-472aca8a-4fec-413d-9238-58223b787b69" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee08c86-902d-44a2-a46a-c76d5afe3831]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:06 devstack sudo[94840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69
Jul 17 03:46:06 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:07 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69" returned: 0 in 0.795s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:07 devstack sudo[94879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69
Jul 17 03:46:07 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:08 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-472aca8a-4fec-413d-9238-58223b787b69" returned: 0 in 0.911s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-472aca8a-4fec-413d-9238-58223b787b69" released by "delete_volume" :: held 1.792s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Created reservations ['d3d71773-cdde-4c3f-afff-286943aeefd4', '6394417e-4c91-4bd6-8525-68b4914ac686', 'af4c67cd-8234-49c7-a78c-205e1cab55c3', '1ef8b584-e748-454d-9ef7-42458cbddd7d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:08 devstack sudo[94916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:08 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:09 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.588s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Deleted volume successfully.
Jul 17 03:46:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5d680c0b-11fc-470b-be99-51e7b986b9a1 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-472aca8a-4fec-413d-9238-58223b787b69-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (e02e8075-0b41-4525-b8a3-3d05867fd6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d273d4-530c-409d-a877-4c3f74cede9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d273d4-530c-409d-a877-4c3f74cede9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1426884955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67111f3-44b2-47f0-a66c-68d9ecfd4ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:10Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4aa516-3dd1-4548-a84f-aef69db7263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4aa516-3dd1-4548-a84f-aef69db7263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb1532-8345-42b9-86c8-1e0a7f595939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77eb1532-8345-42b9-86c8-1e0a7f595939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67111f3-44b2-47f0-a66c-68d9ecfd4ecc', 'volume_name': 'volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e53a417-3b19-4413-8ee5-3caf446bee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e53a417-3b19-4413-8ee5-3caf446bee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225a42fc-78d2-4974-b7e0-6e818645468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Volume a67111f3-44b2-47f0-a66c-68d9ecfd4ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc', 'volume_size': 1}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1426884955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67111f3-44b2-47f0-a66c-68d9ecfd4ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:10Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Creating volume a67111f3-44b2-47f0-a66c-68d9ecfd4ecc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:46:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:10 devstack sudo[94937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc 1073741824
Jul 17 03:46:10 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5bf6e063-45b8-45a0-a2b3-886656b6c0a6 req-c14d4d3b-c8e7-47f9-96bf-747122baf609 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-973feb80-c68a-44b1-8874-fe3bcd5beb27 tempest-VolumesActionsTest-961347983 None] Acquiring lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-973feb80-c68a-44b1-8874-fe3bcd5beb27 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec" acquired by "attach_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-973feb80-c68a-44b1-8874-fe3bcd5beb27 tempest-VolumesActionsTest-961347983 None] Attaching volume cadd8931-f04a-4a22-9f04-e026e11d87ec to instance 88134396-4543-4eeb-8404-260d9036e62c at mountpoint /dev/vdb on host None.
Jul 17 03:46:10 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc 1073741824" returned: 0 in 0.617s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-973feb80-c68a-44b1-8874-fe3bcd5beb27 tempest-VolumesActionsTest-961347983 None] Attach volume completed successfully.
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-973feb80-c68a-44b1-8874-fe3bcd5beb27 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec" released by "attach_volume" :: held 0.098s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:10 devstack sudo[94943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc
Jul 17 03:46:10 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab855411-bc21-4369-8ea1-a8d86b35a783 tempest-VolumesActionsTest-961347983 None] Acquiring lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab855411-bc21-4369-8ea1-a8d86b35a783 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ab855411-bc21-4369-8ea1-a8d86b35a783 tempest-VolumesActionsTest-961347983 None] Detaching volume cadd8931-f04a-4a22-9f04-e026e11d87ec from instance 88134396-4543-4eeb-8404-260d9036e62c.
Jul 17 03:46:11 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5bf6e063-45b8-45a0-a2b3-886656b6c0a6 req-c14d4d3b-c8e7-47f9-96bf-747122baf609 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.806s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225a42fc-78d2-4974-b7e0-6e818645468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e44f42c-5bb5-4920-a867-fb5f50a94f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Volume volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc (a67111f3-44b2-47f0-a66c-68d9ecfd4ecc): created successfully
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e44f42c-5bb5-4920-a867-fb5f50a94f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (e02e8075-0b41-4525-b8a3-3d05867fd6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5bf6e063-45b8-45a0-a2b3-886656b6c0a6 req-c14d4d3b-c8e7-47f9-96bf-747122baf609 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.110s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-98f18fe5-d859-4c1d-bafe-0d60d7be99ac tempest-VolumesActionsTest-1239271041 None] Created volume successfully.
Jul 17 03:46:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ab855411-bc21-4369-8ea1-a8d86b35a783 tempest-VolumesActionsTest-961347983 None] Detach volume completed successfully.
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-5bf6e063-45b8-45a0-a2b3-886656b6c0a6 req-c14d4d3b-c8e7-47f9-96bf-747122baf609 tempest-TestInstancesWithCinderVolumes-561002478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-65299a4e-2402-4ed6-aa26-3d6d832401e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c599d8d-e623-46a0-843d-8e3238d46a31', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:46:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ab855411-bc21-4369-8ea1-a8d86b35a783 tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-detach_volume" released by "detach_volume" :: held 0.171s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-5bf6e063-45b8-45a0-a2b3-886656b6c0a6 req-c14d4d3b-c8e7-47f9-96bf-747122baf609 tempest-TestInstancesWithCinderVolumes-561002478 None] attachment_update completed successfully.
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:12 devstack sudo[94966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:12 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:12 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "cinder-quobyte-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[793ce006-6b7f-459d-b50b-8f3f72eb1e23]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:12 devstack sudo[94980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc
Jul 17 03:46:12 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:13 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc" returned: 0 in 0.482s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:13 devstack sudo[94990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc
Jul 17 03:46:13 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:13 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-quobyte-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc" released by "delete_volume" :: held 0.895s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Created reservations ['19860bcf-6a1f-42d0-80f3-be52c62602d0', 'edd423b7-40c8-4377-bb55-5409ca3f2c4d', 'db5b2148-57d1-49f1-9c95-67b3a580fa0e', '00bed7c0-8240-4b1f-b816-bdcb4f786e9d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1be1eeb8-6bf4-403e-a336-4993b72c3d41 req-1ae00612-0951-4dc9-a476-ad5689aa00c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1be1eeb8-6bf4-403e-a336-4993b72c3d41 req-1ae00612-0951-4dc9-a476-ad5689aa00c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1be1eeb8-6bf4-403e-a336-4993b72c3d41 req-1ae00612-0951-4dc9-a476-ad5689aa00c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-1be1eeb8-6bf4-403e-a336-4993b72c3d41 req-1ae00612-0951-4dc9-a476-ad5689aa00c1 tempest-TestInstancesWithCinderVolumes-561002478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-2bf1b345-54cd-4e30-a99d-43f7af828455', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cc79596-7293-4f33-bfdc-2e08818a8e3f', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:46:13 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:13 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-1be1eeb8-6bf4-403e-a336-4993b72c3d41 req-1ae00612-0951-4dc9-a476-ad5689aa00c1 tempest-TestInstancesWithCinderVolumes-561002478 None] attachment_update completed successfully.
Jul 17 03:46:14 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Deleted volume successfully.
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4817a2e5-55e6-4f22-99a9-d4b95e801b29 tempest-VolumesActionsTest-1548850973 None] Lock "cinder-a67111f3-44b2-47f0-a66c-68d9ecfd4ecc-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (da8281e1-5f0d-48fe-9dde-7439a8140dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312985c5-da2c-4232-a3dd-b3ef62523f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312985c5-da2c-4232-a3dd-b3ef62523f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1730757022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b5dc4c-00a1-4c24-b38e-d60d425f66f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:14Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff197af-0bae-4bc7-b280-e2bd938be308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff197af-0bae-4bc7-b280-e2bd938be308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b315a9-3edd-48b5-8f6e-03917bd9bac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b315a9-3edd-48b5-8f6e-03917bd9bac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b5dc4c-00a1-4c24-b38e-d60d425f66f6', 'volume_name': 'volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27499ab-d332-4dcf-8f2d-0ba1b2e461c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27499ab-d332-4dcf-8f2d-0ba1b2e461c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388ebcac-461d-4b97-b08f-efe57415974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Volume 93b5dc4c-00a1-4c24-b38e-d60d425f66f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6', 'volume_size': 1}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1730757022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b5dc4c-00a1-4c24-b38e-d60d425f66f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e672230d3ce4573ba096665fb86af94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:14Z,use_quota=True,user_id='0ce4b24939b04939b69443bff32b151e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Creating volume 93b5dc4c-00a1-4c24-b38e-d60d425f66f6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:46:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:46:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:14 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6 1073741824
Jul 17 03:46:14 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:15 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6 1073741824" returned: 0 in 0.509s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:15 devstack sudo[95014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6
Jul 17 03:46:15 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:15 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (388ebcac-461d-4b97-b08f-efe57415974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb42166c-b808-4297-b128-1fd90cf0ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Volume volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6 (93b5dc4c-00a1-4c24-b38e-d60d425f66f6): created successfully
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb42166c-b808-4297-b128-1fd90cf0ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Flow 'volume_create_manager' (da8281e1-5f0d-48fe-9dde-7439a8140dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-02efcca4-99da-4c48-888f-e0b1881806f1 tempest-VolumesActionsTest-1239271041 None] Created volume successfully.
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfebcd60-b7b6-4c7d-8096-3637d4022115]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:16 devstack sudo[95026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:46:16 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:16 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd389d32-32d6-4ea1-abce-f532b8b65ee5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:16 devstack sudo[95032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:46:16 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:16 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.13ea08fd-75a3-4bd5-8ed2-f569d1e1264b81aibrck.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:16 devstack sudo[95037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.13ea08fd-75a3-4bd5-8ed2-f569d1e1264b81aibrck.img
Jul 17 03:46:16 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "cinder-93b5dc4c-00a1-4c24-b38e-d60d425f66f6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-93b5dc4c-00a1-4c24-b38e-d60d425f66f6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "cinder-quobyte-93b5dc4c-00a1-4c24-b38e-d60d425f66f6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-quobyte-93b5dc4c-00a1-4c24-b38e-d60d425f66f6" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6543351e-1c44-4409-a709-520199392788]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:17 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6
Jul 17 03:46:17 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:18 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6" returned: 0 in 0.950s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:18 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6
Jul 17 03:46:18 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:18 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-93b5dc4c-00a1-4c24-b38e-d60d425f66f6" returned: 0 in 0.666s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-quobyte-93b5dc4c-00a1-4c24-b38e-d60d425f66f6" released by "delete_volume" :: held 1.705s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Created reservations ['645b49b8-1920-48de-a3cd-380b9d672000', '8763d969-bfb2-4ece-8ccb-13e16c7d665b', '23c107b4-484f-4bad-b030-34153a71d508', '634a1ca0-b043-418f-8c82-bba311187ed2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:46:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:19 devstack sudo[95080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:19 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:20 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.732s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Deleted volume successfully.
Jul 17 03:46:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7d53cea-9411-4d7a-936a-3bbc0514a712 tempest-VolumesActionsTest-1239271041 None] Lock "cinder-93b5dc4c-00a1-4c24-b38e-d60d425f66f6-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-97b2b58b-06a1-436a-b127-a9bbb20efde4 req-044d51d6-2b59-433a-8d45-4a24bf101f8b tempest-TestInstancesWithCinderVolumes-561002478 None] Terminate volume connection completed successfully.
Jul 17 03:46:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-97b2b58b-06a1-436a-b127-a9bbb20efde4 req-044d51d6-2b59-433a-8d45-4a24bf101f8b tempest-TestInstancesWithCinderVolumes-561002478 None] Deleting attachment 7c599d8d-e623-46a0-843d-8e3238d46a31. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:46:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "cinder-65299a4e-2402-4ed6-aa26-3d6d832401e5-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-65299a4e-2402-4ed6-aa26-3d6d832401e5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "cinder-quobyte-65299a4e-2402-4ed6-aa26-3d6d832401e5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-quobyte-65299a4e-2402-4ed6-aa26-3d6d832401e5" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece4ddb9-d94f-4f2e-8481-f439d259d5cd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:22 devstack sudo[95095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5
Jul 17 03:46:22 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:23 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5" returned: 0 in 0.933s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:23 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.13ea08fd-75a3-4bd5-8ed2-f569d1e1264b81aibrck.img" returned: 0 in 6.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:23 devstack sudo[95110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5
Jul 17 03:46:23 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aa8cc2-13e7-473c-a640-d024079b9b0e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:23 devstack sudo[95112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:46:23 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:23 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-65299a4e-2402-4ed6-aa26-3d6d832401e5" returned: 0 in 0.437s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-quobyte-65299a4e-2402-4ed6-aa26-3d6d832401e5" released by "delete_volume" :: held 1.482s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:23 devstack cinder-volume[87498]: WARNING cinder.quota [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55786702-1985938708 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55786702-1985938708, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:46:23 devstack cinder-volume[87498]: WARNING cinder.quota [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55786702-1985938708 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-55786702-1985938708, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Created reservations ['00d3b58e-03d6-498c-b62d-1ef0e3a9698a', 'bbf29804-26e3-4196-b5f6-7de2306a1a85', 'c5227b2e-aafa-44b2-a2ed-a800572e236e', '80d66035-bee4-4085-89b3-d1c078ca4972'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:23 devstack sudo[95119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:23 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:23 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.717s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.13ea08fd-75a3-4bd5-8ed2-f569d1e1264b81aibrck.img {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:46:23 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Converted 1024.00 MB image at 161.96 MB/s
Jul 17 03:46:23 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] 13ea08fd-75a3-4bd5-8ed2-f569d1e1264b was raw, no need to convert to raw {{(pid=87498) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 17 03:46:24 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:24 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Deleted volume successfully.
Jul 17 03:46:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a1277f1-7cb7-46b1-8fc8-023166b69ca3 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-65299a4e-2402-4ed6-aa26-3d6d832401e5-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-b244d52c-3733-4869-bf8c-12928ba4e395 req-1dfc0eb5-4dfb-4cef-9f46-7d56a3fcc245 tempest-TestInstancesWithCinderVolumes-561002478 None] Terminate volume connection completed successfully.
Jul 17 03:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-b244d52c-3733-4869-bf8c-12928ba4e395 req-1dfc0eb5-4dfb-4cef-9f46-7d56a3fcc245 tempest-TestInstancesWithCinderVolumes-561002478 None] Deleting attachment 3cc79596-7293-4f33-bfdc-2e08818a8e3f. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:46:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "cinder-2bf1b345-54cd-4e30-a99d-43f7af828455-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-2bf1b345-54cd-4e30-a99d-43f7af828455-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "cinder-quobyte-2bf1b345-54cd-4e30-a99d-43f7af828455" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-quobyte-2bf1b345-54cd-4e30-a99d-43f7af828455" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7602361c-c883-41c3-a340-a54bb6fe36b3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:27 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455
Jul 17 03:46:27 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:28 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455" returned: 0 in 0.601s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:28 devstack sudo[95154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455
Jul 17 03:46:28 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:28 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2bf1b345-54cd-4e30-a99d-43f7af828455" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-quobyte-2bf1b345-54cd-4e30-a99d-43f7af828455" released by "delete_volume" :: held 1.006s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:28 devstack cinder-volume[87498]: WARNING cinder.quota [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024456885-893492980 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024456885-893492980, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:46:28 devstack cinder-volume[87498]: WARNING cinder.quota [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024456885-893492980 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1024456885-893492980, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Created reservations ['4eb8c397-f370-4f25-aa18-e630d6846567', 'f734b58a-9a2e-44e3-8d0f-a97220167209', 'e622dea7-b266-40cd-bddb-f95f909b64dc', 'c03096ce-238c-4e4a-9530-b3d833dfe38d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:28 devstack sudo[95157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:28 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:29 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Deleted volume successfully.
Jul 17 03:46:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6069e01e-2871-4f02-8759-6c97c62947c2 tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-2bf1b345-54cd-4e30-a99d-43f7af828455-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-670d861e-1813-4ea5-bf87-523b291c5074 req-d7dbe28b-7647-4c03-baac-81a34a28d7f8 tempest-TestInstancesWithCinderVolumes-561002478 None] Terminate volume connection completed successfully.
Jul 17 03:46:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-670d861e-1813-4ea5-bf87-523b291c5074 req-d7dbe28b-7647-4c03-baac-81a34a28d7f8 tempest-TestInstancesWithCinderVolumes-561002478 None] Deleting attachment 61e5374c-1c56-4c94-a346-a17f8850bf3b. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:46:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "cinder-c975383f-34f5-44f1-a2be-816d733b5eb9-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-c975383f-34f5-44f1-a2be-816d733b5eb9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "cinder-quobyte-c975383f-34f5-44f1-a2be-816d733b5eb9" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:46:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-9061ae28-ab1f-4cf6-9cf4-f3bb2cd3221d req-4f180899-6ca5-49e2-806f-2d9e79bd56fa tempest-AttachVolumeTestJSON-153690705 None] Terminate volume connection completed successfully.
Jul 17 03:46:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-9061ae28-ab1f-4cf6-9cf4-f3bb2cd3221d req-4f180899-6ca5-49e2-806f-2d9e79bd56fa tempest-AttachVolumeTestJSON-153690705 None] Deleting attachment f2e3e30e-a266-4177-969f-d17bdd088e30. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:46:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-quobyte-c975383f-34f5-44f1-a2be-816d733b5eb9" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:46:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc1a1f-2ac3-4e03-920e-c7eb37d949dc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:34 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9
Jul 17 03:46:34 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:34 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:34 devstack sudo[95235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9
Jul 17 03:46:34 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:35 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c975383f-34f5-44f1-a2be-816d733b5eb9" returned: 0 in 0.449s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-quobyte-c975383f-34f5-44f1-a2be-816d733b5eb9" released by "delete_volume" :: held 1.030s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:35 devstack cinder-volume[87498]: WARNING cinder.quota [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-16619303-1090057527 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-16619303-1090057527, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:46:35 devstack cinder-volume[87498]: WARNING cinder.quota [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-16619303-1090057527 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-16619303-1090057527, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Created reservations ['e1c0a4c4-8b8a-42d2-970a-981ee02f9207', '9dee8730-47b6-408b-9661-05609175898c', 'bdfc3844-a7d9-491d-88b9-2f098f3df180', 'dcdb57b9-a5c1-48a5-892a-271df94ef69f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:35 devstack sudo[95243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:46:35 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:35 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:46:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Deleted volume successfully.
Jul 17 03:46:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1086200-2f64-4d92-be0b-cbf2dcede2ae tempest-TestInstancesWithCinderVolumes-561002478 None] Lock "cinder-c975383f-34f5-44f1-a2be-816d733b5eb9-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:46:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Flow 'volume_create_manager' (dea47d67-03f9-4c86-9a0f-ac0253b3dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459cfd9-6581-47b8-9ee6-08ba0e9439e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f459cfd9-6581-47b8-9ee6-08ba0e9439e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1549694367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63c0c19-4052-4b53-9f5c-1da6531c2727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4324b9b0172e4a84a8c13440e820e950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:37Z,use_quota=True,user_id='e25578c08fa74621871a7db7b2a77be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d468ef33-9a16-4da2-962c-61926b61a7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d468ef33-9a16-4da2-962c-61926b61a7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991fcd9b-ba96-406d-804b-afe813bcd1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991fcd9b-ba96-406d-804b-afe813bcd1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63c0c19-4052-4b53-9f5c-1da6531c2727', 'volume_name': 'volume-a63c0c19-4052-4b53-9f5c-1da6531c2727', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb41d5d-7103-4ffd-8e93-26ff4125aa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfb41d5d-7103-4ffd-8e93-26ff4125aa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b051b252-4b07-4383-b6ad-292274be2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Volume a63c0c19-4052-4b53-9f5c-1da6531c2727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63c0c19-4052-4b53-9f5c-1da6531c2727', 'volume_size': 1}
Jul 17 03:46:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:46 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=78,cinder:UPDATE=92,cinder:DELETE=7,cinder:INSERT=19 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:46:47 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=86,cinder:UPDATE=83,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.034s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Uploaded volume to glance image-id: 13ea08fd-75a3-4bd5-8ed2-f569d1e1264b. {{(pid=87498) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.900s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1549694367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63c0c19-4052-4b53-9f5c-1da6531c2727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4324b9b0172e4a84a8c13440e820e950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:37Z,use_quota=True,user_id='e25578c08fa74621871a7db7b2a77be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Creating volume a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:46:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:53 devstack sudo[95359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 1073741824
Jul 17 03:46:53 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2eac474b-ded9-4cce-8161-6916a333536e tempest-VolumesActionsTest-961347983 None] Copy volume to image completed successfully.
Jul 17 03:46:53 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 1073741824" returned: 0 in 0.535s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:53 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727
Jul 17 03:46:53 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:53 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b051b252-4b07-4383-b6ad-292274be2029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63c0c19-4052-4b53-9f5c-1da6531c2727', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea6c7e-3d27-4d48-aeb7-6bdaf53791bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Volume volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 (a63c0c19-4052-4b53-9f5c-1da6531c2727): created successfully
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea6c7e-3d27-4d48-aeb7-6bdaf53791bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Flow 'volume_create_manager' (dea47d67-03f9-4c86-9a0f-ac0253b3dded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7f45a7d4-8b3b-40fc-99c9-136a041e1d3a tempest-VolumesCloneTest-479623272 None] Created volume successfully.
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (bb0f3d7a-1943-45a7-ae3c-71593f220ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7637c8-4519-4bba-bafc-f37e306e5d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de7637c8-4519-4bba-bafc-f37e306e5d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262228753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97412cd1-fe85-4917-9681-aa9a51ec7ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:54Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a39fe78-5338-441e-a0ad-b18d6704b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a39fe78-5338-441e-a0ad-b18d6704b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef57b1d-eca9-4088-a080-c731cdcb5884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef57b1d-eca9-4088-a080-c731cdcb5884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97412cd1-fe85-4917-9681-aa9a51ec7ec6', 'volume_name': 'volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246f8ac4-ebb4-40b5-9ee8-74490c9445f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246f8ac4-ebb4-40b5-9ee8-74490c9445f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d1159a-c4a0-4e4b-94d1-324b32759554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Volume 97412cd1-fe85-4917-9681-aa9a51ec7ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6', 'volume_size': 1}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262228753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97412cd1-fe85-4917-9681-aa9a51ec7ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:54Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Creating volume 97412cd1-fe85-4917-9681-aa9a51ec7ec6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:46:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:54 devstack sudo[95370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6 1073741824
Jul 17 03:46:54 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (e930a1fc-a00f-4d22-8ff3-a77da28da24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802f2006-9f82-4671-9d5f-af5d3d33249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (802f2006-9f82-4671-9d5f-af5d3d33249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225388274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755465e6-429b-4ef5-8ed3-1fb6cac2d18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:55Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69195ff5-cbdc-4c07-afe0-17a5d19628e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69195ff5-cbdc-4c07-afe0-17a5d19628e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c912280a-6f8d-482e-ab12-45c02c3d7fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c912280a-6f8d-482e-ab12-45c02c3d7fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '755465e6-429b-4ef5-8ed3-1fb6cac2d18e', 'volume_name': 'volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2823c5eb-d4d6-4221-8b7f-d79f2dbcde17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2823c5eb-d4d6-4221-8b7f-d79f2dbcde17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0080a3-c48c-40f5-9de4-97a8a8539b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Volume 755465e6-429b-4ef5-8ed3-1fb6cac2d18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e', 'volume_size': 1}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:54 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6 1073741824" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:55 devstack sudo[95376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6
Jul 17 03:46:55 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (563697c3-3b52-4d79-bf1e-73116112f3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000a07e7-1cf5-4806-98aa-8494c8d17635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000a07e7-1cf5-4806-98aa-8494c8d17635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584582996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06673d67-20a2-47a9-a7d6-ff0aa2c07b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:55Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ac59ad-0b1d-4713-8fc8-0047cbd916ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ac59ad-0b1d-4713-8fc8-0047cbd916ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcf4104-d005-4a59-bc2c-b422ffb3348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcf4104-d005-4a59-bc2c-b422ffb3348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06673d67-20a2-47a9-a7d6-ff0aa2c07b11', 'volume_name': 'volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6af85d-9f71-469f-847d-9461cf6d2c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6af85d-9f71-469f-847d-9461cf6d2c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20781c89-9aa0-4384-92ed-beaf8ca0f0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Volume 06673d67-20a2-47a9-a7d6-ff0aa2c07b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11', 'volume_size': 1}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:55 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225388274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755465e6-429b-4ef5-8ed3-1fb6cac2d18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:55Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Creating volume 755465e6-429b-4ef5-8ed3-1fb6cac2d18e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:46:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d1159a-c4a0-4e4b-94d1-324b32759554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81c647b-3590-4e9e-8f7d-16d8edde882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack sudo[95379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e 1073741824
Jul 17 03:46:55 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Volume volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6 (97412cd1-fe85-4917-9681-aa9a51ec7ec6): created successfully
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81c647b-3590-4e9e-8f7d-16d8edde882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (bb0f3d7a-1943-45a7-ae3c-71593f220ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-257cde47-b793-4804-9fa8-b6d8ccca69cc tempest-CreateVolumesFromImageTest-710654862 None] Created volume successfully.
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (7950a338-606a-4f31-9da5-f1a6a55c97c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd4699d-0173-4461-b58f-372bdabdbc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd4699d-0173-4461-b58f-372bdabdbc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204276365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b497fb-f36a-4f96-8a14-7439fe1b379f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:56Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9df5a7-b252-4394-96e5-9f5d05adefd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:55 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9df5a7-b252-4394-96e5-9f5d05adefd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d706d67d-f529-405b-ab49-e6eb6cd9630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d706d67d-f529-405b-ab49-e6eb6cd9630a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0b497fb-f36a-4f96-8a14-7439fe1b379f', 'volume_name': 'volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a0287c-1de8-4343-b1ec-7ea55af72541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a0287c-1de8-4343-b1ec-7ea55af72541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd97067c-fa76-4b22-9cc1-7de6739420a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Volume e0b497fb-f36a-4f96-8a14-7439fe1b379f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f', 'volume_size': 1}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e 1073741824" returned: 0 in 0.640s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Flow 'volume_create_manager' (7a23c066-5885-42f8-b892-24357e6a212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:56 devstack sudo[95387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e
Jul 17 03:46:56 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330baf5f-c493-4c04-8b97-748a9788c7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330baf5f-c493-4c04-8b97-748a9788c7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1280876006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c4ae4f-ffde-41a3-b171-0bcd22ed39a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4324b9b0172e4a84a8c13440e820e950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=a63c0c19-4052-4b53-9f5c-1da6531c2727,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:56Z,use_quota=True,user_id='e25578c08fa74621871a7db7b2a77be6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1f81c1-13f3-4814-b30c-59185467138b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1f81c1-13f3-4814-b30c-59185467138b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca597ed-23e9-4c29-8e34-a88ae16d0a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca597ed-23e9-4c29-8e34-a88ae16d0a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '50c4ae4f-ffde-41a3-b171-0bcd22ed39a9', 'volume_name': 'volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9', 'volume_size': 2, 'source_volid': 'a63c0c19-4052-4b53-9f5c-1da6531c2727', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aae4137-8577-41bf-ae62-bbf471dbdc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aae4137-8577-41bf-ae62-bbf471dbdc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7710eba9-f49a-48f3-9565-fbc26edd1049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Volume 50c4ae4f-ffde-41a3-b171-0bcd22ed39a9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9', 'volume_size': 2, 'source_volid': 'a63c0c19-4052-4b53-9f5c-1da6531c2727', 'source_volstatus': 'available'}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (ad9eb80f-033e-41e6-838d-beb282b1e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd14077-b33a-4af5-8418-5c6adf807e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd14077-b33a-4af5-8418-5c6adf807e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899517877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3eea9c6-66de-41a9-877c-2d753596ae6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:56Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7f38dd-41b3-416d-82d2-0cf832b014e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7f38dd-41b3-416d-82d2-0cf832b014e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e95f19-3280-4c37-9d6b-1ef9926e0712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e95f19-3280-4c37-9d6b-1ef9926e0712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3eea9c6-66de-41a9-877c-2d753596ae6c', 'volume_name': 'volume-a3eea9c6-66de-41a9-877c-2d753596ae6c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84718ecc-dc01-4cb3-b8ea-b4e429faaab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84718ecc-dc01-4cb3-b8ea-b4e429faaab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc80f49e-e804-4c59-8398-bc13210acdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Volume a3eea9c6-66de-41a9-877c-2d753596ae6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3eea9c6-66de-41a9-877c-2d753596ae6c', 'volume_size': 1}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:46:56 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.140s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0080a3-c48c-40f5-9de4-97a8a8539b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975f47b8-b21c-430a-92ef-9be17fd2d354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a8b992-9b82-48e0-9194-c366206d38bd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Volume volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e (755465e6-429b-4ef5-8ed3-1fb6cac2d18e): created successfully
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975f47b8-b21c-430a-92ef-9be17fd2d354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (e930a1fc-a00f-4d22-8ff3-a77da28da24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:46:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a0e20433-27ec-4df5-b4a5-76d488872000 tempest-CreateVolumesFromImageTest-710654862 None] Created volume successfully.
Jul 17 03:46:56 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:46:56 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:56 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4b71b6-ef99-4927-a029-4e201b8dd05f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:46:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:56 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:46:56 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:46:57 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Jul 17 03:46:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:46:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:46:57 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img
Jul 17 03:46:57 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:01 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img" returned: 0 in 4.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ead8307-a87c-4217-8797-496b60efe5b3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:01 devstack sudo[95414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:47:01 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:02 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.578s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:02 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:47:02 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Converted 1024.00 MB image at 234.73 MB/s
Jul 17 03:47:02 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] a86e74a9-219b-422c-bec1-ae9a3b09389c was raw, converting to qcow2 {{(pid=87498) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 17 03:47:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cfb446-f69a-4e4a-8cda-60a43772e8f9]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:02 devstack sudo[95422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img
Jul 17 03:47:02 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:02 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:02 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img
Jul 17 03:47:02 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:03 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img" returned: 1 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img /opt/stack/data/cinder/conversion/vol_upload_n2m0fuu2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:03 devstack sudo[95454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img /opt/stack/data/cinder/conversion/vol_upload_n2m0fuu2
Jul 17 03:47:03 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:03 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img /opt/stack/data/cinder/conversion/vol_upload_n2m0fuu2" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Image conversion details: src /opt/stack/data/cinder/conversion/cadd8931-f04a-4a22-9f04-e026e11d87ec.temp_image.a86e74a9-219b-422c-bec1-ae9a3b09389ccvqzuvgp.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_n2m0fuu2 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:47:03 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b2256e-b2c5-40e9-b49b-9524c78cd72a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n2m0fuu2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:03 devstack sudo[95461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n2m0fuu2
Jul 17 03:47:03 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:03 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n2m0fuu2" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.793s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Uploaded volume to glance image-id: a86e74a9-219b-422c-bec1-ae9a3b09389c. {{(pid=87498) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.815s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-584582996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06673d67-20a2-47a9-a7d6-ff0aa2c07b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:55Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Creating volume 06673d67-20a2-47a9-a7d6-ff0aa2c07b11 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:05 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11 1073741824
Jul 17 03:47:05 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a448372e-6ff2-407d-90fc-e9ab672c46a5 tempest-VolumesActionsTest-961347983 None] Copy volume to image completed successfully.
Jul 17 03:47:05 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11 1073741824" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:05 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11
Jul 17 03:47:05 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:05 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.940s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1204276365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0b497fb-f36a-4f96-8a14-7439fe1b379f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:56Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Creating volume e0b497fb-f36a-4f96-8a14-7439fe1b379f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20781c89-9aa0-4384-92ed-beaf8ca0f0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e903013f-433f-4a43-afbd-a03bb1538304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:06 devstack sudo[95481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f 1073741824
Jul 17 03:47:06 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Volume volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11 (06673d67-20a2-47a9-a7d6-ff0aa2c07b11): created successfully
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e903013f-433f-4a43-afbd-a03bb1538304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (563697c3-3b52-4d79-bf1e-73116112f3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cfbf8b03-cd19-4339-ac5f-2566c899c955 tempest-CreateVolumesFromImageTest-710654862 None] Created volume successfully.
Jul 17 03:47:06 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f 1073741824" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Acquiring lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:06 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f
Jul 17 03:47:06 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Acquiring lock "cinder-quobyte-cadd8931-f04a-4a22-9f04-e026e11d87ec" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Lock "cinder-quobyte-cadd8931-f04a-4a22-9f04-e026e11d87ec" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740b83c-4a81-4966-81c6-9c20282f2b46]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:06 devstack sudo[95488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:47:06 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:06 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 10.705s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Cloning volume a63c0c19-4052-4b53-9f5c-1da6531c2727 to volume 50c4ae4f-ffde-41a3-b171-0bcd22ed39a9
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd97067c-fa76-4b22-9cc1-7de6739420a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1f74ce-fca9-4da7-a3ce-b07efaa12b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Volume volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f (e0b497fb-f36a-4f96-8a14-7439fe1b379f): created successfully
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1f74ce-fca9-4da7-a3ce-b07efaa12b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (7950a338-606a-4f31-9da5-f1a6a55c97c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Creating offline snapshot a56bec7c-4ee1-443b-b9a7-06d69371eb27 of volume a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca53e91-2a00-422b-8a46-47097d22b86c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eaae942c-d939-4844-8ec0-3c1d879e9247 tempest-CreateVolumesFromImageTest-710654862 None] Created volume successfully.
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:07 devstack sudo[95491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727
Jul 17 03:47:07 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:07 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:07 devstack sudo[95496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec
Jul 17 03:47:07 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:07 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cadd8931-f04a-4a22-9f04-e026e11d87ec" returned: 0 in 0.261s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:07 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727" returned: 0 in 0.442s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Lock "cinder-quobyte-cadd8931-f04a-4a22-9f04-e026e11d87ec" released by "delete_volume" :: held 0.762s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:07 devstack sudo[95502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 1G
Jul 17 03:47:07 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Created reservations ['09a1c8f0-123c-43fc-8faa-8a0ca7215592', '0101a071-e0a2-4279-be47-7cb3ac2782e9', 'da940dfc-54e9-4267-a6e4-ea8cfa199fdd', '957b4e93-61e8-4977-a1ff-bef389870869'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:07 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:07 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:07 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Deleted volume successfully.
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b0724401-c727-4120-a0c0-d1e056dfd4ce tempest-VolumesActionsTest-961347983 None] Lock "cinder-cadd8931-f04a-4a22-9f04-e026e11d87ec-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:08 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 1G" returned: 0 in 0.558s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:08 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27
Jul 17 03:47:08 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:08 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:08 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 is being set with open permissions: ugo+rw
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:08 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27
Jul 17 03:47:08 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:08 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:08 devstack sudo[95518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.info
Jul 17 03:47:08 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:08 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.info" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:08 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.info is being set with open permissions: ugo+rw
Jul 17 03:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:08 devstack sudo[95521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.info
Jul 17 03:47:08 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:09 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.info" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Acquiring lock "cinder-quobyte-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] snapshot: a56bec7c-4ee1-443b-b9a7-06d69371eb27, volume: 50c4ae4f-ffde-41a3-b171-0bcd22ed39a9,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0166b97-5852-4fc1-8fa1-0dc86efe57e9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:09 devstack sudo[95528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27
Jul 17 03:47:09 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:09 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27" returned: 0 in 0.454s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a63c0c19-4052-4b53-9f5c-1da6531c2727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c189dd78-3b64-409e-bd65-0da820f3f9df]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:09 devstack sudo[95534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727
Jul 17 03:47:09 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:10 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:10 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:47:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:10 devstack sudo[95539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9
Jul 17 03:47:10 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:47:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:12 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:12 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:13 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 1.018s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:13 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:47:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:47:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:47:16 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" returned: 0 in 6.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0190429-98a8-48ad-afe1-2e5e68053ced]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:16 devstack sudo[95574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727
Jul 17 03:47:16 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:17 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727" returned: 0 in 0.697s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:17 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:47:17 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Converted 1024.00 MB image at 160.72 MB/s
Jul 17 03:47:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 is being set with open permissions: ugo+rw
Jul 17 03:47:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:17 devstack sudo[95591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9
Jul 17 03:47:17 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:17 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" returned: 0 in 0.547s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" released by "_copy_volume_from_snapshot" :: held 8.630s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Acquiring lock "cinder-quobyte-a56bec7c-4ee1-443b-b9a7-06d69371eb27" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-a56bec7c-4ee1-443b-b9a7-06d69371eb27" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Deleting offline snapshot a56bec7c-4ee1-443b-b9a7-06d69371eb27 of volume a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] snapshot_file for this snap is: volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4af453c-4b15-4b22-833b-3d2bf4774a01]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:18 devstack sudo[95639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27
Jul 17 03:47:18 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:47:18 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27" returned: 0 in 0.598s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a63c0c19-4052-4b53-9f5c-1da6531c2727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f543d392-327e-4d5a-ba33-ff0db552f707]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:18 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727
Jul 17 03:47:18 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Flow 'volume_create_manager' (6d45c400-1036-4415-a8dc-1bf34b820fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de3178-45e5-417b-9090-cc10455f6e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de3178-45e5-417b-9090-cc10455f6e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1082811498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf3908f-c688-492f-b11e-a06fff445760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451b624a62ba41e48decc292a7e1409d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:19Z,use_quota=True,user_id='194fea7cde794584b1cc71ba20fe6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ef9c69-e2c1-458b-aafd-00decf80601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ef9c69-e2c1-458b-aafd-00decf80601b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddc4ee5-cc66-4732-8ccc-e390f9f3bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 03:47:19 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:19 devstack sudo[95661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27
Jul 17 03:47:19 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddc4ee5-cc66-4732-8ccc-e390f9f3bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0cf3908f-c688-492f-b11e-a06fff445760', 'volume_name': 'volume-0cf3908f-c688-492f-b11e-a06fff445760', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ca8b860>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3704efc1-5349-48de-bd45-4b4b656aa97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3704efc1-5349-48de-bd45-4b4b656aa97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539afa4e-01d6-4049-8e26-87f99bc66bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Volume 0cf3908f-c688-492f-b11e-a06fff445760: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0cf3908f-c688-492f-b11e-a06fff445760', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ca8b860>}
Jul 17 03:47:19 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Trying to clone 0cf3908f-c688-492f-b11e-a06fff445760 from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 at location (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 03:47:19 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27" returned: 0 in 0.647s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:20 devstack sudo[95667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27
Jul 17 03:47:20 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 03:47:20 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Image download 20.69 MB at 20.69 MB/s
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e5b9d6-d62e-47a6-96eb-47974d691f39]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:20 devstack sudo[95670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD
Jul 17 03:47:20 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:20 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727.a56bec7c-4ee1-443b-b9a7-06d69371eb27" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-a56bec7c-4ee1-443b-b9a7-06d69371eb27" released by "_delete_snapshot" :: held 2.360s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.453s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.077s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899517877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3eea9c6-66de-41a9-877c-2d753596ae6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ccf9a960454d56af81aacfda93fa8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:46:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:46:56Z,use_quota=True,user_id='5b97de282cfa421e8cc9a3c41f2309f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Creating volume a3eea9c6-66de-41a9-877c-2d753596ae6c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7710eba9-f49a-48f3-9565-fbc26edd1049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9', 'volume_size': 2, 'source_volid': 'a63c0c19-4052-4b53-9f5c-1da6531c2727', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:20 devstack sudo[95673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c 1073741824
Jul 17 03:47:20 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be91ec9-1b01-4bc4-ac85-ae33b43c7c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Volume volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 (50c4ae4f-ffde-41a3-b171-0bcd22ed39a9): created successfully
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4be91ec9-1b01-4bc4-ac85-ae33b43c7c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Flow 'volume_create_manager' (7a23c066-5885-42f8-b892-24357e6a212e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:20 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 is fetched for user 194fea7cde794584b1cc71ba20fe6601. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 03:47:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fc60b170-8fa4-461a-a236-98ae6dcb6314 tempest-VolumesCloneTest-479623272 None] Created volume successfully.
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae983b1-3092-4b00-b2bb-6a651e68bbe3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:20 devstack sudo[95679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD
Jul 17 03:47:20 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:21 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:21 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c 1073741824" returned: 0 in 0.705s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:21 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c
Jul 17 03:47:21 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:21 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1082811498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf3908f-c688-492f-b11e-a06fff445760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451b624a62ba41e48decc292a7e1409d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:19Z,use_quota=True,user_id='194fea7cde794584b1cc71ba20fe6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Creating volume 0cf3908f-c688-492f-b11e-a06fff445760 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Acquiring lock "cinder-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:21 devstack sudo[95691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 1073741824
Jul 17 03:47:21 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc80f49e-e804-4c59-8398-bc13210acdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3eea9c6-66de-41a9-877c-2d753596ae6c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9eb9f29-71ee-4cc9-bd5a-ef34c55d32c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Lock "cinder-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Volume volume-a3eea9c6-66de-41a9-877c-2d753596ae6c (a3eea9c6-66de-41a9-877c-2d753596ae6c): created successfully
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9eb9f29-71ee-4cc9-bd5a-ef34c55d32c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Flow 'volume_create_manager' (ad9eb80f-033e-41e6-838d-beb282b1e414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-600d8ca1-992c-4399-81bd-f604d554108e tempest-CreateVolumesFromImageTest-710654862 None] Created volume successfully.
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Acquiring lock "cinder-quobyte-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5bc77a-8b85-4dcb-8c7b-94e0e5d095c1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:21 devstack sudo[95693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9
Jul 17 03:47:21 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-a3eea9c6-66de-41a9-877c-2d753596ae6c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-a3eea9c6-66de-41a9-877c-2d753596ae6c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-quobyte-a3eea9c6-66de-41a9-877c-2d753596ae6c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-a3eea9c6-66de-41a9-877c-2d753596ae6c" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67cac5-a457-4cf7-a6f9-4b066edcd06b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:22 devstack sudo[95698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c
Jul 17 03:47:22 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:22 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" returned: 0 in 0.673s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:22 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 1073741824" returned: 0 in 0.941s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:22 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9
Jul 17 03:47:22 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:22 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760
Jul 17 03:47:22 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:22 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c" returned: 0 in 0.590s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:22 devstack sudo[95714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c
Jul 17 03:47:22 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:22 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" returned: 0 in 0.454s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9" released by "delete_volume" :: held 1.189s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:22 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Created reservations ['4e7a70b4-b72e-4c90-ae2d-0f7f98b10725', 'bc5f9ba3-9cae-43d3-a3c2-06185a67e434', 'f4d10185-1475-49fd-b520-09e548ab8aa8', '41037456-d629-4de5-b0fd-14b705da3574'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Attempting download of 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume 0cf3908f-c688-492f-b11e-a06fff445760. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 03:47:23 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a3eea9c6-66de-41a9-877c-2d753596ae6c" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c910882a-18d4-4988-9da6-82a0f65b0ed3]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_3d3di2qi {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:23 devstack sudo[95719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:23 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-a3eea9c6-66de-41a9-877c-2d753596ae6c" released by "delete_volume" :: held 1.146s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Created reservations ['2557c931-468c-4066-bda3-5a47be4a65f0', '48390f28-5643-44f4-9a8f-d6156bedd235', '2d42bcfe-4779-4358-858b-20a665c0bd63', 'aa612ee2-eadc-4af3-b1ff-4c76199eaec8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:23 devstack sudo[95720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_3d3di2qi
Jul 17 03:47:23 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:23 devstack sudo[95724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:23 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:23 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.498s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Deleted volume successfully.
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62b08358-48c6-4d58-b6a5-83a3199f23b2 tempest-VolumesCloneTest-479623272 None] Lock "cinder-50c4ae4f-ffde-41a3-b171-0bcd22ed39a9-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:23 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:23 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_3d3di2qi" returned: 0 in 0.714s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_3d3di2qi {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Deleted volume successfully.
Jul 17 03:47:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e15df84e-ea63-4728-ab4d-75f4198b4200 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-a3eea9c6-66de-41a9-877c-2d753596ae6c-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Acquiring lock "cinder-a63c0c19-4052-4b53-9f5c-1da6531c2727-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Lock "cinder-a63c0c19-4052-4b53-9f5c-1da6531c2727-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Acquiring lock "cinder-quobyte-a63c0c19-4052-4b53-9f5c-1da6531c2727" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-a63c0c19-4052-4b53-9f5c-1da6531c2727" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:24 devstack sudo[95738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_3d3di2qi
Jul 17 03:47:24 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e531d852-0437-4b17-8690-50fde18cb89f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-e0b497fb-f36a-4f96-8a14-7439fe1b379f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-e0b497fb-f36a-4f96-8a14-7439fe1b379f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:24 devstack sudo[95740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727
Jul 17 03:47:24 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:24 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_3d3di2qi" returned: 1 in 0.591s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_3d3di2qi' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa9552b-b7e6-454d-b402-1dd929fbf948]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-quobyte-e0b497fb-f36a-4f96-8a14-7439fe1b379f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-e0b497fb-f36a-4f96-8a14-7439fe1b379f" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae0f08d-5bb2-40cf-a08e-791a032d18f5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:24 devstack sudo[95744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD
Jul 17 03:47:24 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:24 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:24 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f
Jul 17 03:47:24 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:24 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727
Jul 17 03:47:24 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:24 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 03:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:25 devstack sudo[95756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760
Jul 17 03:47:25 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:25 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a63c0c19-4052-4b53-9f5c-1da6531c2727" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Lock "cinder-quobyte-a63c0c19-4052-4b53-9f5c-1da6531c2727" released by "delete_volume" :: held 0.921s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:25 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:25 devstack sudo[95762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f
Jul 17 03:47:25 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Created reservations ['f30b9c12-f594-4a46-8ab1-6ee7d2e49a8a', '9d670a32-0dac-43e0-8c21-151a0fad8be0', 'ca71d159-0365-441a-969a-32ebb3084fea', '7a00d982-c636-46ca-bd2f-10448aab73ca'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:25 devstack sudo[95770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:25 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:25 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e0b497fb-f36a-4f96-8a14-7439fe1b379f" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-e0b497fb-f36a-4f96-8a14-7439fe1b379f" released by "delete_volume" :: held 0.861s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Created reservations ['c866f8e9-045e-48a5-ace1-b8ce25dbc8ea', '1b8c2742-2077-4075-8904-352e52b4e0ec', '047fc5c3-0c06-4276-b799-eb8c19d8a255', '33ba73c0-d3b4-4c38-8143-15329a2905d6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:25 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Deleted volume successfully.
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-724be3d7-df0b-4d6a-b50e-1a8afae829b6 tempest-VolumesCloneTest-479623272 None] Lock "cinder-a63c0c19-4052-4b53-9f5c-1da6531c2727-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:25 devstack sudo[95775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:25 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:26 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Deleted volume successfully.
Jul 17 03:47:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90d3d592-e2ab-48e7-80ce-a5961d99693f tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-e0b497fb-f36a-4f96-8a14-7439fe1b379f-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-06673d67-20a2-47a9-a7d6-ff0aa2c07b11-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-06673d67-20a2-47a9-a7d6-ff0aa2c07b11-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-quobyte-06673d67-20a2-47a9-a7d6-ff0aa2c07b11" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-06673d67-20a2-47a9-a7d6-ff0aa2c07b11" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37df947-2e52-4444-9194-a3d2fdceb577]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:27 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11
Jul 17 03:47:27 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:27 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760" returned: 0 in 2.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_915r9a6bdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:47:27 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Converted 112.00 MB image at 47.72 MB/s
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:27 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 1G
Jul 17 03:47:27 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:27 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11" returned: 0 in 0.569s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:27 devstack sudo[95789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11
Jul 17 03:47:27 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:27 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 1G" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Downloaded image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume 0cf3908f-c688-492f-b11e-a06fff445760 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 for user 194fea7cde794584b1cc71ba20fe6601 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Marking volume 0cf3908f-c688-492f-b11e-a06fff445760 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Copying metadata from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 to 0cf3908f-c688-492f-b11e-a06fff445760. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Creating volume glance metadata for volume 0cf3908f-c688-492f-b11e-a06fff445760 backed by image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539afa4e-01d6-4049-8e26-87f99bc66bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf3908f-c688-492f-b11e-a06fff445760', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ca8b860>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e813d75d-b9d4-42f9-853b-0b8c1340dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Volume volume-0cf3908f-c688-492f-b11e-a06fff445760 (0cf3908f-c688-492f-b11e-a06fff445760): created successfully
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e813d75d-b9d4-42f9-853b-0b8c1340dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Flow 'volume_create_manager' (6d45c400-1036-4415-a8dc-1bf34b820fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-75925ac8-0989-4dd9-9154-ad11a59a7ab6 tempest-VolumesExtendTest-1031306026 None] Created volume successfully.
Jul 17 03:47:27 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-06673d67-20a2-47a9-a7d6-ff0aa2c07b11" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-06673d67-20a2-47a9-a7d6-ff0aa2c07b11" released by "delete_volume" :: held 0.960s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Created reservations ['e29034c3-026a-415b-9724-791f6f98d0e4', '11ddc1f5-cc51-46c9-a12a-d5dc3c70da57', 'b5a75c15-39a0-4aee-bd59-fc002b41f92e', 'b8144279-17ce-4af9-8766-e1996e041871'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:28 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:28 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5ff332-a776-43a4-9fbf-829710771252]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:28 devstack sudo[95795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760
Jul 17 03:47:28 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:28 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Deleted volume successfully.
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-41f4090c-2813-4f70-b9fd-0b4965be69b3 tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-06673d67-20a2-47a9-a7d6-ff0aa2c07b11-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:28 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 2G" returned: 0 in 0.099s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.604s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c1e88a91-42d3-488d-b09c-037d63d14c0e tempest-VolumesExtendTest-1031306026 None] Extend volume completed successfully.
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-755465e6-429b-4ef5-8ed3-1fb6cac2d18e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-755465e6-429b-4ef5-8ed3-1fb6cac2d18e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-quobyte-755465e6-429b-4ef5-8ed3-1fb6cac2d18e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-755465e6-429b-4ef5-8ed3-1fb6cac2d18e" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d49bd3-ed33-42cc-8ece-52f14822035b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:29 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e
Jul 17 03:47:29 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "cinder-0cf3908f-c688-492f-b11e-a06fff445760-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-0cf3908f-c688-492f-b11e-a06fff445760-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "cinder-quobyte-0cf3908f-c688-492f-b11e-a06fff445760" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-0cf3908f-c688-492f-b11e-a06fff445760" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf68466-8ada-4781-b93a-2b4d358bee23]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:29 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e" returned: 0 in 0.595s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:29 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e
Jul 17 03:47:29 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:30 devstack sudo[95808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760
Jul 17 03:47:30 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:30 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-755465e6-429b-4ef5-8ed3-1fb6cac2d18e" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:30 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-755465e6-429b-4ef5-8ed3-1fb6cac2d18e" released by "delete_volume" :: held 1.084s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:30 devstack sudo[95817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760
Jul 17 03:47:30 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Created reservations ['cbcc004f-3fe1-4dcf-9d5f-5309b5fcc27b', '19393521-7c83-479b-9f58-3a2837ef627a', '5cf8e0af-222d-4d40-a195-117af2018270', '26b16ead-3006-4665-9aa0-6a72fb256f4a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:30 devstack sudo[95819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:30 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:30 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0cf3908f-c688-492f-b11e-a06fff445760" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-0cf3908f-c688-492f-b11e-a06fff445760" released by "delete_volume" :: held 1.008s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:30 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Deleted volume successfully.
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Created reservations ['57db12a1-bdd8-4e17-baec-4d207bbea19c', 'f2fe5487-ee48-4004-8dc6-3c1e93b3e886', '71580a35-02df-4348-b5e3-ad2bd09348ad', '79569a70-6ae5-4f94-8de9-545bca18916c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e88d8ae-dd2e-4beb-8122-ddf5d88348cd tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-755465e6-429b-4ef5-8ed3-1fb6cac2d18e-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:31 devstack sudo[95823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:31 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:31 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Deleted volume successfully.
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31635e85-d378-4e1c-88f7-66bcb7d231e4 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-0cf3908f-c688-492f-b11e-a06fff445760-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-97412cd1-fe85-4917-9681-aa9a51ec7ec6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-97412cd1-fe85-4917-9681-aa9a51ec7ec6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "cinder-quobyte-97412cd1-fe85-4917-9681-aa9a51ec7ec6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-97412cd1-fe85-4917-9681-aa9a51ec7ec6" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3beee5e-d833-420f-a756-053edd4638f7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:31 devstack sudo[95835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6
Jul 17 03:47:31 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:32 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6" returned: 0 in 0.572s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:32 devstack sudo[95850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6
Jul 17 03:47:32 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Flow 'volume_create_manager' (2271b005-c0cd-43e8-97c3-2e082e3e44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907a66e8-5025-42ee-9a75-0da9e05b5ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-97412cd1-fe85-4917-9681-aa9a51ec7ec6" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907a66e8-5025-42ee-9a75-0da9e05b5ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1466015796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe41f30-e14a-4f30-9eb9-3c0ae15b477d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac69724904a34ce4901d1ea7a9e1f827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:32Z,use_quota=True,user_id='43423221a5994e9baecfaf7480cc9368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d4dc3d-0f81-4d70-b6cf-0e9b94452b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d4dc3d-0f81-4d70-b6cf-0e9b94452b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae488445-189c-499a-b20a-2f54941fea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae488445-189c-499a-b20a-2f54941fea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe41f30-e14a-4f30-9eb9-3c0ae15b477d', 'volume_name': 'volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51ab6f8-f084-43c4-8ad7-9f7814e40a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51ab6f8-f084-43c4-8ad7-9f7814e40a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee611b8b-23e6-4a17-a6eb-9ad5e8c30fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Volume ebe41f30-e14a-4f30-9eb9-3c0ae15b477d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d', 'volume_size': 1}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1466015796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe41f30-e14a-4f30-9eb9-3c0ae15b477d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac69724904a34ce4901d1ea7a9e1f827',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:32Z,use_quota=True,user_id='43423221a5994e9baecfaf7480cc9368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Creating volume ebe41f30-e14a-4f30-9eb9-3c0ae15b477d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:32 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-quobyte-97412cd1-fe85-4917-9681-aa9a51ec7ec6" released by "delete_volume" :: held 0.991s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:32 devstack sudo[95853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d 1073741824
Jul 17 03:47:32 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Flow 'volume_create_manager' (8d1911a8-2796-40c5-a484-43a257f20f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b4d8a6-50e5-4cfe-9427-02d3be48575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b4d8a6-50e5-4cfe-9427-02d3be48575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1156826569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50970f7d-51a4-471f-8d0c-46a87f41c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451b624a62ba41e48decc292a7e1409d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:33Z,use_quota=True,user_id='194fea7cde794584b1cc71ba20fe6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502e6abb-8a05-41c6-acf7-3abc8d1e8270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (502e6abb-8a05-41c6-acf7-3abc8d1e8270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103e1372-1463-4314-b489-3685a163ac46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103e1372-1463-4314-b489-3685a163ac46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50970f7d-51a4-471f-8d0c-46a87f41c5ff', 'volume_name': 'volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d863e-ac88-46f2-8ae4-66f31013d7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614d863e-ac88-46f2-8ae4-66f31013d7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99072b82-a3f8-4462-855a-891fe90a966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Volume 50970f7d-51a4-471f-8d0c-46a87f41c5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff', 'volume_size': 1}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Created reservations ['27a18da9-19c1-466a-8a16-a1acbba9ce7a', '36a0af08-3353-4bd7-9056-70b539ddea87', '393b7bfb-c4ea-4d5f-839f-bbb6939cc3db', 'f748063d-82aa-43a7-913e-525d1ee8f5ea'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:32 devstack sudo[95870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:32 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:33 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d 1073741824" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:33 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:33 devstack sudo[95895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d
Jul 17 03:47:33 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Deleted volume successfully.
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a66aef03-90aa-46d5-b1c5-965bdc5c141d tempest-CreateVolumesFromImageTest-710654862 None] Lock "cinder-97412cd1-fe85-4917-9681-aa9a51ec7ec6-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:33 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1156826569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50970f7d-51a4-471f-8d0c-46a87f41c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451b624a62ba41e48decc292a7e1409d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:33Z,use_quota=True,user_id='194fea7cde794584b1cc71ba20fe6601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Creating volume 50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee611b8b-23e6-4a17-a6eb-9ad5e8c30fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:33 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff 1073741824
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d024bcb-93fe-4ea3-841c-e651457db5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:33 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Volume volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d (ebe41f30-e14a-4f30-9eb9-3c0ae15b477d): created successfully
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d024bcb-93fe-4ea3-841c-e651457db5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Flow 'volume_create_manager' (2271b005-c0cd-43e8-97c3-2e082e3e44d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-07040f59-74a9-4db8-b1d1-d251a177fe9c tempest-VolumesNegativeTest-1025535423 None] Created volume successfully.
Jul 17 03:47:33 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff 1073741824" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:33 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff
Jul 17 03:47:33 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:34 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99072b82-a3f8-4462-855a-891fe90a966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240add0e-a00d-4b99-aabf-0e476d8bb3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Volume volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff (50970f7d-51a4-471f-8d0c-46a87f41c5ff): created successfully
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240add0e-a00d-4b99-aabf-0e476d8bb3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Flow 'volume_create_manager' (8d1911a8-2796-40c5-a484-43a257f20f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c057157a-8948-47c0-a05d-017b056f53f6 tempest-VolumesExtendTest-1031306026 None] Created volume successfully.
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Creating offline snapshot 66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e of volume 50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[48097f75-6f8d-4944-9248-afc0bcd7a3ea]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:34 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff
Jul 17 03:47:34 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:35 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:35 devstack sudo[95919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e 1G
Jul 17 03:47:35 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:35 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e 1G" returned: 0 in 0.547s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:35 devstack sudo[95925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e
Jul 17 03:47:35 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:36 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:36 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e is being set with open permissions: ugo+rw
Jul 17 03:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:36 devstack sudo[95931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e
Jul 17 03:47:36 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:36 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:36 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.info
Jul 17 03:47:36 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:36 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.info" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:37 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.info is being set with open permissions: ugo+rw
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:37 devstack sudo[95938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.info
Jul 17 03:47:37 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (03dfb3f9-3552-4ff0-92dc-ca5ec037822b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfbf5e9-f177-437d-9f66-d80ca0353f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfbf5e9-f177-437d-9f66-d80ca0353f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992312627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:37Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b63627-ac13-40c7-92de-baee20253088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b63627-ac13-40c7-92de-baee20253088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b75dd9f-6f53-4bcd-bd96-be92e08e85c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b75dd9f-6f53-4bcd-bd96-be92e08e85c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb', 'volume_name': 'volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483ac9b0-c645-49d7-a93a-3801af35cae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483ac9b0-c645-49d7-a93a-3801af35cae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f980f957-547e-404d-8945-61ca140a3569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb', 'volume_size': 1}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:37 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.info" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992312627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:37Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Creating volume fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:37 devstack sudo[95947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb 1073741824
Jul 17 03:47:37 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-07c5f447-b860-4bc3-9ccc-d4b89abc01dc tempest-VolumesExtendTest-1031306026 None] Create snapshot completed successfully
Jul 17 03:47:37 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb 1073741824" returned: 0 in 0.524s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:37 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb
Jul 17 03:47:37 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:38 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.084s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f980f957-547e-404d-8945-61ca140a3569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d7da69-8695-40f7-a7e6-f2fc82cae1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[680f69dd-23c4-4c8b-8f75-73176407ec03]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb (fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb): created successfully
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d7da69-8695-40f7-a7e6-f2fc82cae1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (03dfb3f9-3552-4ff0-92dc-ca5ec037822b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-90db45d3-861b-4c8f-9de1-55f9849ef917 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created volume successfully.
Jul 17 03:47:38 devstack sudo[95965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff
Jul 17 03:47:38 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:38 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e 2G" returned: 0 in 0.169s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.635s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-38521cf9-b77e-4ebd-b49c-d57f3f8202bf tempest-VolumesExtendTest-1031306026 None] Extend volume completed successfully.
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Creating offline snapshot c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 of volume fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "cinder-66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "cinder-quobyte-50970f7d-51a4-471f-8d0c-46a87f41c5ff" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36d8d36-1266-49ce-b2a3-a2b7571984d2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-50970f7d-51a4-471f-8d0c-46a87f41c5ff" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "cinder-quobyte-66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Deleting offline snapshot 66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e of volume 50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] snapshot_file for this snap is: volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7f65a2-b4df-4fa0-92a5-77c158e14795]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:39 devstack sudo[95976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb
Jul 17 03:47:39 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:39 devstack sudo[95977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e
Jul 17 03:47:39 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:40 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" returned: 0 in 0.545s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:40 devstack sudo[95986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 1G
Jul 17 03:47:40 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:40 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b21c138-3b5c-44a5-a01a-2cafb98818f5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:40 devstack sudo[95989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff
Jul 17 03:47:40 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:40 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:40 devstack sudo[96036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e
Jul 17 03:47:40 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:41 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 1G" returned: 0 in 0.947s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:41 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01
Jul 17 03:47:41 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:41 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" returned: 0 in 0.667s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:41 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e
Jul 17 03:47:41 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:41 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 is being set with open permissions: ugo+rw
Jul 17 03:47:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:41 devstack sudo[96075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01
Jul 17 03:47:41 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:42 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff.66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:42 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e" released by "_delete_snapshot" :: held 2.312s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-50970f7d-51a4-471f-8d0c-46a87f41c5ff" released by "delete_snapshot" :: held 2.348s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:42 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.info
Jul 17 03:47:42 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Created reservations ['892fe572-ac9d-4941-935a-08c89eefec83', 'cfa8da29-0029-4eaf-aa27-2cbb856bdb7f', 'a04f9c8e-311a-4171-aea6-02549b962c38', '256d6255-13f7-4812-8e0c-a54cdf348ed2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Delete snapshot completed successfully.
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-14c3b610-d42a-413b-9fd9-9dc4c49771e3 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-66f5c5ed-eb4e-4d04-a8e3-04ce4e3e510e-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:42 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.info" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:42 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.info is being set with open permissions: ugo+rw
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:42 devstack sudo[96089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.info
Jul 17 03:47:42 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:42 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.info" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.240s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d09f1768-d33c-41a7-8528-2199323ba195 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Create snapshot completed successfully
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "cinder-50970f7d-51a4-471f-8d0c-46a87f41c5ff-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Flow 'volume_create_manager' (ac7c64df-a579-49b2-aee2-88c82fe705c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0dcb4-adae-48aa-ade2-dc1708e0c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-50970f7d-51a4-471f-8d0c-46a87f41c5ff-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d0dcb4-adae-48aa-ade2-dc1708e0c180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1097940048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c409afe0-7350-4e9a-b641-fcdb4f0cc945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c6cc6dc92747488bf02c63ab76b34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:43Z,use_quota=True,user_id='78ea951c89814f989b05b2dbf47ce3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4de50fa-4475-4d3b-ba8d-0ef1f309b13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4de50fa-4475-4d3b-ba8d-0ef1f309b13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af81db9-c4e6-48f9-b466-f49f8de049e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1af81db9-c4e6-48f9-b466-f49f8de049e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c409afe0-7350-4e9a-b641-fcdb4f0cc945', 'volume_name': 'volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5441bc-f8a7-4b66-b2b5-f21e3f836df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a5441bc-f8a7-4b66-b2b5-f21e3f836df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af59bb24-f173-4191-a608-9b9736476b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Volume c409afe0-7350-4e9a-b641-fcdb4f0cc945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945', 'volume_size': 1}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1097940048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c409afe0-7350-4e9a-b641-fcdb4f0cc945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c6cc6dc92747488bf02c63ab76b34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:43Z,use_quota=True,user_id='78ea951c89814f989b05b2dbf47ce3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Creating volume c409afe0-7350-4e9a-b641-fcdb4f0cc945 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:43 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "cinder-quobyte-50970f7d-51a4-471f-8d0c-46a87f41c5ff" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:43 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945 1073741824
Jul 17 03:47:43 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-50970f7d-51a4-471f-8d0c-46a87f41c5ff" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27849c2-d844-4893-b7df-952cbfd68f7c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:43 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff
Jul 17 03:47:43 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:43 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945 1073741824" returned: 0 in 0.626s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:44 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff" returned: 0 in 0.675s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:44 devstack sudo[96118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff
Jul 17 03:47:44 devstack sudo[96117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945
Jul 17 03:47:44 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:44 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:44 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af59bb24-f173-4191-a608-9b9736476b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53045e39-8dbb-419b-a095-c12436a5c6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Volume volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945 (c409afe0-7350-4e9a-b641-fcdb4f0cc945): created successfully
Jul 17 03:47:44 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53045e39-8dbb-419b-a095-c12436a5c6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Flow 'volume_create_manager' (ac7c64df-a579-49b2-aee2-88c82fe705c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-50970f7d-51a4-471f-8d0c-46a87f41c5ff" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (9c1f9d7e-fb54-4038-b1bb-6d4d130f142c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22ca1a8-13f9-4c65-8066-3d78c23bf9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22ca1a8-13f9-4c65-8066-3d78c23bf9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245532465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734e251b-3af3-46fd-8919-e22182282bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:44Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabef1c9-3a2b-4c73-acd4-530779dbf553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eabef1c9-3a2b-4c73-acd4-530779dbf553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31d3545-9373-4742-836b-04e5fd635059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e31d3545-9373-4742-836b-04e5fd635059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734e251b-3af3-46fd-8919-e22182282bee', 'volume_name': 'volume-734e251b-3af3-46fd-8919-e22182282bee', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f340a2a7-f64b-495b-94dd-6f7027bafb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f340a2a7-f64b-495b-94dd-6f7027bafb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28958378-64a0-4a0b-b5ee-b90d4ac94ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume 734e251b-3af3-46fd-8919-e22182282bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734e251b-3af3-46fd-8919-e22182282bee', 'volume_size': 1}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245532465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734e251b-3af3-46fd-8919-e22182282bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:44Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Creating volume 734e251b-3af3-46fd-8919-e22182282bee {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-quobyte-50970f7d-51a4-471f-8d0c-46a87f41c5ff" released by "delete_volume" :: held 1.406s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f0afa049-0f2b-42cd-85fc-411cdab6d933 tempest-AttachVolumeTestJSON-153690705 None] Created volume successfully.
Jul 17 03:47:44 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee 1073741824
Jul 17 03:47:44 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Created reservations ['0232b457-f57b-44be-8542-5783d5dd86fd', 'c3c61eb9-902a-4a80-8d77-33d14938947e', '08f71297-3400-4b6f-b10d-66e8aa2257e1', '7cefc717-ca7b-4bba-8ddc-7e1d0cbffb9c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:45 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:45 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (1c35b896-b30e-4d47-b50a-9d83387b5563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b35e2f2-faa5-410b-bd07-e2974d0ae3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b35e2f2-faa5-410b-bd07-e2974d0ae3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1852052851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8326e4-80fe-4cef-a1c0-c0fccbf06276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:45Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9461a3d0-d6a2-44dd-8478-cb125c60d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9461a3d0-d6a2-44dd-8478-cb125c60d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a73573-78d9-486a-a255-f14cc5436355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a73573-78d9-486a-a255-f14cc5436355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8326e4-80fe-4cef-a1c0-c0fccbf06276', 'volume_name': 'volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87840d6b-d44f-44c9-85c7-06e90db147e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87840d6b-d44f-44c9-85c7-06e90db147e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb8ca54-40c5-44a7-9e4f-d1cf625570aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume ec8326e4-80fe-4cef-a1c0-c0fccbf06276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276', 'volume_size': 1}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:45 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Deleted volume successfully.
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27ec53b4-8129-44a8-8b20-c586ef680a41 tempest-VolumesExtendTest-1031306026 None] Lock "cinder-50970f7d-51a4-471f-8d0c-46a87f41c5ff-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:45 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee 1073741824" returned: 0 in 0.848s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:45 devstack sudo[96144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee
Jul 17 03:47:45 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (30ea363f-a58b-48df-80bf-e2f59aecf1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942efcde-b076-4d9e-ae30-f822ba7b3694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942efcde-b076-4d9e-ae30-f822ba7b3694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069712442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b68fde-9cfb-4da0-8325-d4e33fc159c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:46Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f648b65-d800-409c-8a28-3d7a30163cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f648b65-d800-409c-8a28-3d7a30163cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8847b704-d8a1-47ec-9cec-0652728e4aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8847b704-d8a1-47ec-9cec-0652728e4aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71b68fde-9cfb-4da0-8325-d4e33fc159c6', 'volume_name': 'volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9324d47a-dbf9-47ed-9cfa-788be571030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9324d47a-dbf9-47ed-9cfa-788be571030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8451ad0d-a6f1-4411-a87e-5a6a4c3a7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume 71b68fde-9cfb-4da0-8325-d4e33fc159c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6', 'volume_size': 1}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:46 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1852052851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8326e4-80fe-4cef-a1c0-c0fccbf06276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:45Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Creating volume ec8326e4-80fe-4cef-a1c0-c0fccbf06276 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:46 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28958378-64a0-4a0b-b5ee-b90d4ac94ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734e251b-3af3-46fd-8919-e22182282bee', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:46 devstack sudo[96149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276 1073741824
Jul 17 03:47:46 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4e65ba-5446-46f7-b06c-d95b545a8285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume volume-734e251b-3af3-46fd-8919-e22182282bee (734e251b-3af3-46fd-8919-e22182282bee): created successfully
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4e65ba-5446-46f7-b06c-d95b545a8285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (9c1f9d7e-fb54-4038-b1bb-6d4d130f142c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f6329897-012c-4caf-8c88-a7151fa5034c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created volume successfully.
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (10302a36-509c-4e55-8ca7-aabff231a580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fede07de-982d-4d96-a8fb-fa174a5e8e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-8587f275-4b19-43ee-adba-e02d16bce9f8 req-7c957130-4f6a-4d56-893b-0bad713b13b8 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fede07de-982d-4d96-a8fb-fa174a5e8e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843842827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a084032-865d-4cb1-8d62-6f1cf1e24853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:47Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d9cb80-4eca-4dda-85e5-a8648335d3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d9cb80-4eca-4dda-85e5-a8648335d3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed17e92-858a-4546-9603-75a9f526ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed17e92-858a-4546-9603-75a9f526ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a084032-865d-4cb1-8d62-6f1cf1e24853', 'volume_name': 'volume-8a084032-865d-4cb1-8d62-6f1cf1e24853', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e6eefe-0e53-4901-b785-116dcd3c3c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7e6eefe-0e53-4901-b785-116dcd3c3c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fb8544-e944-4a79-b2ef-23c36b31f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume 8a084032-865d-4cb1-8d62-6f1cf1e24853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a084032-865d-4cb1-8d62-6f1cf1e24853', 'volume_size': 1}
Jul 17 03:47:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:47 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276 1073741824" returned: 0 in 0.961s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:47 devstack sudo[96163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276
Jul 17 03:47:47 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (172694af-55a5-4ced-b6c8-264e4fb92d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6174f3ef-0782-458f-bf32-553331709d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6174f3ef-0782-458f-bf32-553331709d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680267628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2865a9d-2d1b-4192-bab7-86284585de01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:47Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fc60c3-a32c-42d3-baa1-4e682d9384c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0fc60c3-a32c-42d3-baa1-4e682d9384c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfb3c05-b928-4165-ae8f-38fe00ca8da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbfb3c05-b928-4165-ae8f-38fe00ca8da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2865a9d-2d1b-4192-bab7-86284585de01', 'volume_name': 'volume-a2865a9d-2d1b-4192-bab7-86284585de01', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bef3ee-050a-4174-b71d-789d4399033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49bef3ee-050a-4174-b71d-789d4399033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f53b7d-8fda-409b-b483-a72bc1f5f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume a2865a9d-2d1b-4192-bab7-86284585de01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2865a9d-2d1b-4192-bab7-86284585de01', 'volume_size': 1}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:47 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2069712442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71b68fde-9cfb-4da0-8325-d4e33fc159c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:46Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Creating volume 71b68fde-9cfb-4da0-8325-d4e33fc159c6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb8ca54-40c5-44a7-9e4f-d1cf625570aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b87a8f-5742-486d-8013-7f1c14888bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:47 devstack sudo[96166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6 1073741824
Jul 17 03:47:47 devstack sudo[96166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276 (ec8326e4-80fe-4cef-a1c0-c0fccbf06276): created successfully
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b87a8f-5742-486d-8013-7f1c14888bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (1c35b896-b30e-4d47-b50a-9d83387b5563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f907a395-4b5a-4b83-be4e-88b3e2079e27 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created volume successfully.
Jul 17 03:47:47 devstack sudo[96166]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6 1073741824" returned: 0 in 0.488s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=118,cinder:UPDATE=129,cinder:DELETE=14,cinder:INSERT=43 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:47:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:47 devstack sudo[96173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6
Jul 17 03:47:47 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:48 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-8587f275-4b19-43ee-adba-e02d16bce9f8 req-7c957130-4f6a-4d56-893b-0bad713b13b8 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.429s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-8587f275-4b19-43ee-adba-e02d16bce9f8 req-7c957130-4f6a-4d56-893b-0bad713b13b8 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-843842827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a084032-865d-4cb1-8d62-6f1cf1e24853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:47Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Creating volume 8a084032-865d-4cb1-8d62-6f1cf1e24853 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:48 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8451ad0d-a6f1-4411-a87e-5a6a4c3a7db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808047a7-05fd-44c8-a4de-25e606cef0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:48 devstack sudo[96182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853 1073741824
Jul 17 03:47:48 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6 (71b68fde-9cfb-4da0-8325-d4e33fc159c6): created successfully
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808047a7-05fd-44c8-a4de-25e606cef0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (30ea363f-a58b-48df-80bf-e2f59aecf1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e30f7a7b-237a-4c98-970d-724f9a0d5327 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created volume successfully.
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-8587f275-4b19-43ee-adba-e02d16bce9f8 req-7c957130-4f6a-4d56-893b-0bad713b13b8 tempest-AttachVolumeTestJSON-153690705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '347c5ff1-f014-4b04-b178-5dd5372d636f', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:47:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-8587f275-4b19-43ee-adba-e02d16bce9f8 req-7c957130-4f6a-4d56-893b-0bad713b13b8 tempest-AttachVolumeTestJSON-153690705 None] attachment_update completed successfully.
Jul 17 03:47:48 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853 1073741824" returned: 0 in 0.645s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:49 devstack sudo[96569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853
Jul 17 03:47:49 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:49 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1680267628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2865a9d-2d1b-4192-bab7-86284585de01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73b06b888c6b4242bb030e1ea58060de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:47Z,use_quota=True,user_id='7af7e03e3ab74340b8aa704ee0aaf87e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Creating volume a2865a9d-2d1b-4192-bab7-86284585de01 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fb8544-e944-4a79-b2ef-23c36b31f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a084032-865d-4cb1-8d62-6f1cf1e24853', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb7f6e6-6b64-481f-b848-f9c769f7da2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:49 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01 1073741824
Jul 17 03:47:49 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume volume-8a084032-865d-4cb1-8d62-6f1cf1e24853 (8a084032-865d-4cb1-8d62-6f1cf1e24853): created successfully
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb7f6e6-6b64-481f-b848-f9c769f7da2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (10302a36-509c-4e55-8ca7-aabff231a580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e5fa5773-c286-4bab-92e6-ff86da7917ad tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created volume successfully.
Jul 17 03:47:50 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01 1073741824" returned: 0 in 0.729s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:50 devstack sudo[96578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01
Jul 17 03:47:50 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:50 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f53b7d-8fda-409b-b483-a72bc1f5f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2865a9d-2d1b-4192-bab7-86284585de01', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069efafc-8559-4ea5-a3f3-829107cce40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Flow 'volume_create_manager' (3cf16b53-8716-4b36-97f9-1a65f07ddb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba959dc-143d-4a62-bd5b-7d28700bb17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Volume volume-a2865a9d-2d1b-4192-bab7-86284585de01 (a2865a9d-2d1b-4192-bab7-86284585de01): created successfully
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069efafc-8559-4ea5-a3f3-829107cce40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Flow 'volume_create_manager' (172694af-55a5-4ced-b6c8-264e4fb92d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba959dc-143d-4a62-bd5b-7d28700bb17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1254099220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a6590a-8614-4af9-812c-7147fb528c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c6cc6dc92747488bf02c63ab76b34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:51Z,use_quota=True,user_id='78ea951c89814f989b05b2dbf47ce3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a8b0ae-6c54-49dc-8bd9-e8d11068b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a8b0ae-6c54-49dc-8bd9-e8d11068b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8831a9ae-d7c5-4aa8-bd67-0b249bd0b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8831a9ae-d7c5-4aa8-bd67-0b249bd0b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a6590a-8614-4af9-812c-7147fb528c42', 'volume_name': 'volume-e7a6590a-8614-4af9-812c-7147fb528c42', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04a2785-28d6-4b0a-8201-8c8adac1cd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04a2785-28d6-4b0a-8201-8c8adac1cd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7edbfe-7a3a-4603-b296-9958c0a0682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Volume e7a6590a-8614-4af9-812c-7147fb528c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a6590a-8614-4af9-812c-7147fb528c42', 'volume_size': 1}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1254099220',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a6590a-8614-4af9-812c-7147fb528c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c6cc6dc92747488bf02c63ab76b34f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:47:51Z,use_quota=True,user_id='78ea951c89814f989b05b2dbf47ce3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Creating volume e7a6590a-8614-4af9-812c-7147fb528c42 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:47:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d44e4539-2199-4880-956b-39b4e1c2879f tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created volume successfully.
Jul 17 03:47:50 devstack sudo[96582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42 1073741824
Jul 17 03:47:50 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-a2865a9d-2d1b-4192-bab7-86284585de01-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-a2865a9d-2d1b-4192-bab7-86284585de01-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-a2865a9d-2d1b-4192-bab7-86284585de01" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-a2865a9d-2d1b-4192-bab7-86284585de01" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee850a04-af7a-46c0-a0b6-0ef7393a9a39]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:51 devstack sudo[96585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01
Jul 17 03:47:51 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:51 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42 1073741824" returned: 0 in 0.529s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:51 devstack sudo[96591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42
Jul 17 03:47:51 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:51 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:51 devstack sudo[96596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01
Jul 17 03:47:51 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:51 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7edbfe-7a3a-4603-b296-9958c0a0682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a6590a-8614-4af9-812c-7147fb528c42', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb69b43-075c-49dc-a4bb-d1a4f47766da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:47:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Volume volume-e7a6590a-8614-4af9-812c-7147fb528c42 (e7a6590a-8614-4af9-812c-7147fb528c42): created successfully
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb69b43-075c-49dc-a4bb-d1a4f47766da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Flow 'volume_create_manager' (3cf16b53-8716-4b36-97f9-1a65f07ddb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:47:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2a7e9f5d-8806-494c-9bb3-12db857e33c4 tempest-AttachVolumeTestJSON-153690705 None] Created volume successfully.
Jul 17 03:47:51 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2865a9d-2d1b-4192-bab7-86284585de01" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-a2865a9d-2d1b-4192-bab7-86284585de01" released by "delete_volume" :: held 0.935s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created reservations ['80c6c929-e554-437b-8275-37e62b23a2cf', '11b8e09c-97af-49aa-985a-f3f617475f43', '107f1942-d2e9-4ca3-893d-39f7e9f112c5', '180ecb1b-caa4-4d9d-858f-c91c9464ed22'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:52 devstack sudo[96600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:52 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:52 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Deleted volume successfully.
Jul 17 03:47:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0904682f-f9dd-4c63-af72-294d811a8eea tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-a2865a9d-2d1b-4192-bab7-86284585de01-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-8a084032-865d-4cb1-8d62-6f1cf1e24853-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-8a084032-865d-4cb1-8d62-6f1cf1e24853-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-8a084032-865d-4cb1-8d62-6f1cf1e24853" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-8a084032-865d-4cb1-8d62-6f1cf1e24853" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0515d57-7116-442d-a81b-cb0771ebe092]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:53 devstack sudo[96613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853
Jul 17 03:47:53 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-21d1faff-ce0d-4d80-9eb6-bcfb7046f235 req-8cc02eec-edb0-4909-a5cd-6bdc4f98cc80 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-21d1faff-ce0d-4d80-9eb6-bcfb7046f235 req-8cc02eec-edb0-4909-a5cd-6bdc4f98cc80 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-21d1faff-ce0d-4d80-9eb6-bcfb7046f235 req-8cc02eec-edb0-4909-a5cd-6bdc4f98cc80 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-21d1faff-ce0d-4d80-9eb6-bcfb7046f235 req-8cc02eec-edb0-4909-a5cd-6bdc4f98cc80 tempest-AttachVolumeTestJSON-153690705 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-e7a6590a-8614-4af9-812c-7147fb528c42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a142f6ed-7986-4dd7-b899-a3a3294e87fa', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:47:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-21d1faff-ce0d-4d80-9eb6-bcfb7046f235 req-8cc02eec-edb0-4909-a5cd-6bdc4f98cc80 tempest-AttachVolumeTestJSON-153690705 None] attachment_update completed successfully.
Jul 17 03:47:53 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:54 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853
Jul 17 03:47:54 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:54 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8a084032-865d-4cb1-8d62-6f1cf1e24853" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-8a084032-865d-4cb1-8d62-6f1cf1e24853" released by "delete_volume" :: held 1.011s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created reservations ['ceb34762-4779-4203-ae8d-a68487aff969', '5357f8a3-1adf-4e8c-9a21-e4268b6dabb5', 'e27a1c13-5727-490b-b686-b1b9b4b59515', 'adea9f79-f223-4879-8b34-487be05ce3d7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:54 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:54 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:55 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Deleted volume successfully.
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3a92124a-6edc-475e-b775-80179f0a4381 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-8a084032-865d-4cb1-8d62-6f1cf1e24853-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-71b68fde-9cfb-4da0-8325-d4e33fc159c6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-71b68fde-9cfb-4da0-8325-d4e33fc159c6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-71b68fde-9cfb-4da0-8325-d4e33fc159c6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-71b68fde-9cfb-4da0-8325-d4e33fc159c6" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8aba30-3771-473f-8efe-7eebd304560b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Acquiring lock "cinder-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Lock "cinder-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Acquiring lock "cinder-quobyte-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Lock "cinder-quobyte-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:55 devstack sudo[96630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6
Jul 17 03:47:55 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9db1d7-589c-42d3-a5e0-cbd7bb1f812c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:56 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d
Jul 17 03:47:56 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:56 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:56 devstack sudo[96640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6
Jul 17 03:47:56 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:56 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:56 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d
Jul 17 03:47:56 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:56 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-71b68fde-9cfb-4da0-8325-d4e33fc159c6" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-71b68fde-9cfb-4da0-8325-d4e33fc159c6" released by "delete_volume" :: held 0.991s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-027ebe72-e687-4f33-bfe2-14d26bc5d6a0 req-555a0ba0-090e-415b-b6a4-756307380b07 tempest-AttachVolumeTestJSON-153690705 None] Terminate volume connection completed successfully.
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-027ebe72-e687-4f33-bfe2-14d26bc5d6a0 req-555a0ba0-090e-415b-b6a4-756307380b07 tempest-AttachVolumeTestJSON-153690705 None] Deleting attachment 347c5ff1-f014-4b04-b178-5dd5372d636f. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:47:56 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Lock "cinder-quobyte-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d" released by "delete_volume" :: held 0.917s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created reservations ['601f6b7f-c3cc-436f-bdfe-3e113646cfed', '2975dfc6-b831-483d-a9d9-26859c0284f9', 'd8425127-a6c8-4a93-a9e9-e89ea4890ad2', '777d275c-d74a-4bcf-b2da-bdf8afdfac85'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Created reservations ['ab43e1cd-51be-4484-894a-33d6e4396b3a', '98b85c05-e5a3-4c1d-a47a-c544e2158faa', '12036471-6d1f-4830-aed4-9c1dbc97e55f', '7e8dd0d9-7efd-42da-b441-9ae7e9f7ee81'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:57 devstack sudo[96648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:57 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:57 devstack sudo[96650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:57 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:57 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Deleted volume successfully.
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5e21497f-047a-4fc8-a5eb-377e272ea5d3 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-71b68fde-9cfb-4da0-8325-d4e33fc159c6-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:57 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Deleted volume successfully.
Jul 17 03:47:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-828b7fbf-ef1c-4fcf-b7fc-d80821a0744c tempest-VolumesNegativeTest-1025535423 None] Lock "cinder-ebe41f30-e14a-4f30-9eb9-3c0ae15b477d-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-ec8326e4-80fe-4cef-a1c0-c0fccbf06276-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-a38876e7-b0ee-4286-a54d-f328883ead9b req-4cc2eba7-a91b-4edd-ab47-8b6daf1501b7 tempest-AttachVolumeTestJSON-153690705 None] Terminate volume connection completed successfully.
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-a38876e7-b0ee-4286-a54d-f328883ead9b req-4cc2eba7-a91b-4edd-ab47-8b6daf1501b7 tempest-AttachVolumeTestJSON-153690705 None] Deleting attachment a142f6ed-7986-4dd7-b899-a3a3294e87fa. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-ec8326e4-80fe-4cef-a1c0-c0fccbf06276-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-ec8326e4-80fe-4cef-a1c0-c0fccbf06276" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-ec8326e4-80fe-4cef-a1c0-c0fccbf06276" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c0577-e803-4a7d-a8e1-90a6f9861dbd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:58 devstack sudo[96681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276
Jul 17 03:47:58 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:58 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276" returned: 0 in 0.483s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:59 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276
Jul 17 03:47:59 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:59 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec8326e4-80fe-4cef-a1c0-c0fccbf06276" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-ec8326e4-80fe-4cef-a1c0-c0fccbf06276" released by "delete_volume" :: held 0.895s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created reservations ['1707ffb2-eed0-43ed-b999-b09c2e561c8f', 'd8f30cee-d050-4638-ab0e-76a8799e92dc', '18740932-5e70-4569-852d-49aba98bb0a5', 'e4a79261-cc7b-45e7-b9c5-b4a5b3b78f41'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:47:59 devstack sudo[96689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:47:59 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:47:59 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:47:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:47:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Deleted volume successfully.
Jul 17 03:48:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3934c9b8-0010-4147-8e23-631b8f50efec tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-ec8326e4-80fe-4cef-a1c0-c0fccbf06276-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-734e251b-3af3-46fd-8919-e22182282bee-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-734e251b-3af3-46fd-8919-e22182282bee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-734e251b-3af3-46fd-8919-e22182282bee" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-734e251b-3af3-46fd-8919-e22182282bee" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7092206-2d8d-4f87-902a-133dc9293f27]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:00 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee
Jul 17 03:48:00 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:01 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee" returned: 0 in 0.491s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:01 devstack sudo[96717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee
Jul 17 03:48:01 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:01 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-734e251b-3af3-46fd-8919-e22182282bee" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-734e251b-3af3-46fd-8919-e22182282bee" released by "delete_volume" :: held 0.876s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created reservations ['6c83362f-3c53-4c0b-8643-be3694edd4f6', '324d20de-102b-4062-b2b3-6b8a25bc0a0a', '2e8c06a3-cede-400e-abed-a93de2248b2d', 'ce7e57ad-7d28-40cb-b2a1-74bcdbc98a24'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:01 devstack sudo[96720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:01 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-c09eb7d5-3cee-487c-bfdb-4f8d7410bf01-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-c09eb7d5-3cee-487c-bfdb-4f8d7410bf01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Deleting offline snapshot c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 of volume fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] snapshot_file for this snap is: volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[215a0dba-9428-4f96-8c76-829a86b83659]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:02 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Deleted volume successfully.
Jul 17 03:48:02 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01
Jul 17 03:48:02 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-800eb13f-0751-45c0-a873-4711abee5293 tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-734e251b-3af3-46fd-8919-e22182282bee-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:02 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" returned: 0 in 0.592s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac17d99f-e4a8-4295-9d18-15207488e8ee]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (ae62a538-51f4-48d8-8ba3-5ea71520d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0473ec-1c76-47b4-9951-b66874cfb656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0473ec-1c76-47b4-9951-b66874cfb656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1268419231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dff4b9-9efb-4bba-90bc-8c945c1e6897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:03Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4f89d6-33ea-479f-9b50-f59e67dcf80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4f89d6-33ea-479f-9b50-f59e67dcf80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14523cab-b196-48fd-8d06-7053aa1fc0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14523cab-b196-48fd-8d06-7053aa1fc0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6dff4b9-9efb-4bba-90bc-8c945c1e6897', 'volume_name': 'volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb274950-6363-487c-9c65-ec21845a5ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb274950-6363-487c-9c65-ec21845a5ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c08892-9184-4552-b535-7d261e2abbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Volume b6dff4b9-9efb-4bba-90bc-8c945c1e6897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897', 'volume_size': 1}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1268419231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6dff4b9-9efb-4bba-90bc-8c945c1e6897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:03Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Creating volume b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:02 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:02 devstack sudo[96731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb
Jul 17 03:48:02 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:02 devstack sudo[96732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 1073741824
Jul 17 03:48:02 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:03 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" returned: 0 in 0.629s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:03 devstack sudo[96741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01
Jul 17 03:48:03 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:03 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 1073741824" returned: 0 in 0.843s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:03 devstack sudo[96749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897
Jul 17 03:48:03 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:03 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:03 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01
Jul 17 03:48:03 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:04 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c08892-9184-4552-b535-7d261e2abbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaa6670-8cb2-412c-97c7-ef073c243230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Volume volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 (b6dff4b9-9efb-4bba-90bc-8c945c1e6897): created successfully
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aaa6670-8cb2-412c-97c7-ef073c243230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (ae62a538-51f4-48d8-8ba3-5ea71520d031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9b00be4b-7767-403c-9a8c-07c4e9e8d6c4 tempest-VolumesSnapshotTestJSON-421476903 None] Created volume successfully.
Jul 17 03:48:04 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb.c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-c09eb7d5-3cee-487c-bfdb-4f8d7410bf01" released by "_delete_snapshot" :: held 2.265s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" released by "delete_snapshot" :: held 2.295s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created reservations ['45c01ac2-cddf-4afe-8799-3869d08fc866', '9ce76912-9ecb-4ed2-b05b-b6a93a4ff9ba', '96668eea-b048-48aa-8c7f-61e7739f1950', 'e2ed54a1-3da0-4f3c-bb30-afd201cf9d97'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Delete snapshot completed successfully.
Jul 17 03:48:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e109aed1-4879-4775-9382-39297659647e tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-c09eb7d5-3cee-487c-bfdb-4f8d7410bf01-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Creating offline snapshot f31184eb-3a48-4c06-a63b-c069e47ba8b9 of volume b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7408f470-0389-49b4-bf43-e425fb4b802d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "cinder-quobyte-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2b6d3c-fa01-452f-a851-3b553504b3f3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:05 devstack sudo[96757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897
Jul 17 03:48:05 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "cinder-e7a6590a-8614-4af9-812c-7147fb528c42-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-e7a6590a-8614-4af9-812c-7147fb528c42-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:05 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb
Jul 17 03:48:05 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "cinder-quobyte-e7a6590a-8614-4af9-812c-7147fb528c42" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-quobyte-e7a6590a-8614-4af9-812c-7147fb528c42" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76bfe06-226a-481c-b8c4-e70fd441c176]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:05 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:05 devstack sudo[96761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42
Jul 17 03:48:05 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:05 devstack sudo[96766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 1G
Jul 17 03:48:05 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:05 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" returned: 0 in 0.556s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:05 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb
Jul 17 03:48:05 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:06 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:06 devstack sudo[96781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42
Jul 17 03:48:06 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:06 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-quobyte-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb" released by "delete_volume" :: held 0.946s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:06 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 1G" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:06 devstack sudo[96785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9
Jul 17 03:48:06 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Created reservations ['92002b70-0f6f-4b06-9cdb-580170b8f373', 'dfc26f35-33a5-4d87-80e0-6d16dd7d4cb4', '7c0ec4af-f118-42ab-9a97-774bf2fe8847', 'd9007f27-654b-42b3-b42c-c3d822f1fd2b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:06 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e7a6590a-8614-4af9-812c-7147fb528c42" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-quobyte-e7a6590a-8614-4af9-812c-7147fb528c42" released by "delete_volume" :: held 0.806s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:06 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:06 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Created reservations ['120d3f69-4b12-4cf7-b2f0-cad90ad02e60', '27e42017-5b97-443a-a8e0-5eb19c36f349', '1206fed2-31ff-44c4-982b-630d7f9a26ad', '327e75a2-f37e-4036-81af-903bedf164b7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:06 devstack sudo[96793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:06 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "cinder-c409afe0-7350-4e9a-b641-fcdb4f0cc945-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:06 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-c409afe0-7350-4e9a-b641-fcdb4f0cc945-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9" returned: 0 in 0.489s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:06 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 is being set with open permissions: ugo+rw
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:06 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9
Jul 17 03:48:06 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "cinder-quobyte-c409afe0-7350-4e9a-b641-fcdb4f0cc945" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:06 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-quobyte-c409afe0-7350-4e9a-b641-fcdb4f0cc945" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Deleted volume successfully.
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[09da8d81-c49b-4bb5-8142-bbd1ee51fe24]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-57106453-2d33-43fa-a1fd-9fd71001429c tempest-CreateVolumesFromSnapshotTest-1785098122 None] Lock "cinder-fed8bb8e-9a9d-45db-9e29-ae1bd72a23fb-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:06 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Deleted volume successfully.
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f780e8c-7109-41c9-9cb7-ba9f3f82b031 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-e7a6590a-8614-4af9-812c-7147fb528c42-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:07 devstack sudo[96800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945
Jul 17 03:48:07 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:07 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:07 devstack sudo[96803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.info
Jul 17 03:48:07 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:07 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:07 devstack sudo[96808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945
Jul 17 03:48:07 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:07 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.info" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:07 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.info is being set with open permissions: ugo+rw
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:07 devstack sudo[96811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.info
Jul 17 03:48:07 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:07 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c409afe0-7350-4e9a-b641-fcdb4f0cc945" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-quobyte-c409afe0-7350-4e9a-b641-fcdb4f0cc945" released by "delete_volume" :: held 0.850s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Created reservations ['77ed8a9f-05a9-460b-aa7b-ac2edb9f7ea9', 'ed1edbb6-a374-4a36-9f7a-21862e6ba0cb', 'd3996b8c-91f9-423d-91ab-946c92e037d4', 'cc2daf6b-80c2-4ece-98d4-33cbc0d6b5bd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:07 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.info" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.621s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-878868d0-f5ea-46a7-bd21-ea1a3adafbcc tempest-VolumesSnapshotTestJSON-421476903 None] Create snapshot completed successfully
Jul 17 03:48:07 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:07 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:08 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Deleted volume successfully.
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-479442d5-f923-4b1e-9924-f840e9d7cd17 tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-c409afe0-7350-4e9a-b641-fcdb4f0cc945-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-f31184eb-3a48-4c06-a63b-c069e47ba8b9-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-f31184eb-3a48-4c06-a63b-c069e47ba8b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-f31184eb-3a48-4c06-a63b-c069e47ba8b9" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-f31184eb-3a48-4c06-a63b-c069e47ba8b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Deleting offline snapshot f31184eb-3a48-4c06-a63b-c069e47ba8b9 of volume b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] snapshot_file for this snap is: volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d545432-07ae-4eb8-be86-02c6bc88e69e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:08 devstack sudo[96818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9
Jul 17 03:48:08 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "cinder-c0bb9aca-421d-4d6d-90c0-916cdb51ab46-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:09 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-c0bb9aca-421d-4d6d-90c0-916cdb51ab46-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b593f8-47f6-423e-9bfe-8ad07aa233d9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "cinder-quobyte-c0bb9aca-421d-4d6d-90c0-916cdb51ab46" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-quobyte-c0bb9aca-421d-4d6d-90c0-916cdb51ab46" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[842f4bbe-962b-41cc-9c18-caca7d318385]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:09 devstack sudo[96823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897
Jul 17 03:48:09 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:09 devstack sudo[96824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46
Jul 17 03:48:09 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:09 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" returned: 0 in 0.572s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:09 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9
Jul 17 03:48:09 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:09 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46" returned: 0 in 0.532s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:09 devstack sudo[96835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46
Jul 17 03:48:09 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:10 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c0bb9aca-421d-4d6d-90c0-916cdb51ab46" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-quobyte-c0bb9aca-421d-4d6d-90c0-916cdb51ab46" released by "delete_volume" :: held 1.046s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Created reservations ['7e1ddf26-c3a0-41f3-be50-b02f394cb56f', 'e187b2e5-2f10-4010-8d6f-bb3159cf3293', '373e7165-0225-4268-9b9e-24dbf99333ae', 'ff7b63a3-87fb-4526-8728-d4ea2a252d7a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:10 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9" returned: 0 in 0.652s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:10 devstack sudo[96842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9
Jul 17 03:48:10 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:10 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:10 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:10 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897.f31184eb-3a48-4c06-a63b-c069e47ba8b9" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:10 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-f31184eb-3a48-4c06-a63b-c069e47ba8b9" released by "_delete_snapshot" :: held 2.319s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" released by "delete_snapshot" :: held 2.348s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Deleted volume successfully.
Jul 17 03:48:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-294a08b3-5c9c-49e4-b690-abe649c37fac tempest-AttachVolumeTestJSON-153690705 None] Lock "cinder-c0bb9aca-421d-4d6d-90c0-916cdb51ab46-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['3f1d1c5a-c43b-4309-91c8-607097de16e2', 'f289ebce-d1a7-460d-9665-afb863641c18', '078aa9f1-2cc7-447a-91da-a2bc82be0229', '0cf24f0a-642b-4110-9bbd-3dba84b4cffe'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Delete snapshot completed successfully.
Jul 17 03:48:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b94530e5-ae7e-4e44-98c8-6942b623b349 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-f31184eb-3a48-4c06-a63b-c069e47ba8b9-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (ae1c2302-3425-422b-b46d-4875b815ed1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b3d9cf-338d-421f-a438-95a9444c3c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b3d9cf-338d-421f-a438-95a9444c3c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972221301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18de1947-150e-49f6-9761-a5ef3e007acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:12Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c676d38-4e09-4125-85c6-e7d94c8a6c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c676d38-4e09-4125-85c6-e7d94c8a6c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe5de3d-6e8d-41d5-aa26-bf9e1a43d1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efe5de3d-6e8d-41d5-aa26-bf9e1a43d1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18de1947-150e-49f6-9761-a5ef3e007acd', 'volume_name': 'volume-18de1947-150e-49f6-9761-a5ef3e007acd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bd0417-9b81-43b9-9383-55489bd57317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bd0417-9b81-43b9-9383-55489bd57317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49f43ef-32c4-41ff-b326-cc19042e0ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume 18de1947-150e-49f6-9761-a5ef3e007acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18de1947-150e-49f6-9761-a5ef3e007acd', 'volume_size': 1}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972221301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18de1947-150e-49f6-9761-a5ef3e007acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:12Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Creating volume 18de1947-150e-49f6-9761-a5ef3e007acd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:12 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:12 devstack sudo[96848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd 1073741824
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:48:12 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:12 devstack sudo[96850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:12 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:12 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (617b99ac-ab33-4b48-9b98-c9ce9346be28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be034bc-227b-4f13-a410-4cdc43e33aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be034bc-227b-4f13-a410-4cdc43e33aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-737457261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcf6c22-023e-4c4b-99f7-636b700147c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:13Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4661df16-9477-442d-86b8-05351bc80e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4661df16-9477-442d-86b8-05351bc80e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8614863e-fcba-4f42-b5aa-a57b001eebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8614863e-fcba-4f42-b5aa-a57b001eebca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bcf6c22-023e-4c4b-99f7-636b700147c3', 'volume_name': 'volume-8bcf6c22-023e-4c4b-99f7-636b700147c3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46504302-5eae-43f6-9774-cfd17d0f0f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46504302-5eae-43f6-9774-cfd17d0f0f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75e9505-e8ab-42e7-b7b3-10cc49f76837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Volume 8bcf6c22-023e-4c4b-99f7-636b700147c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bcf6c22-023e-4c4b-99f7-636b700147c3', 'volume_size': 1}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:12 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd 1073741824" returned: 0 in 0.762s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:13 devstack sudo[96856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd
Jul 17 03:48:13 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:13 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-737457261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bcf6c22-023e-4c4b-99f7-636b700147c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:13Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Creating volume 8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49f43ef-32c4-41ff-b326-cc19042e0ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18de1947-150e-49f6-9761-a5ef3e007acd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c567a80a-c012-4417-9875-64e5e5640e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:13 devstack sudo[96859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 1073741824
Jul 17 03:48:13 devstack sudo[96859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume volume-18de1947-150e-49f6-9761-a5ef3e007acd (18de1947-150e-49f6-9761-a5ef3e007acd): created successfully
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c567a80a-c012-4417-9875-64e5e5640e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (ae1c2302-3425-422b-b46d-4875b815ed1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-71644930-82d1-4c2c-9b75-70eedd829233 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created volume successfully.
Jul 17 03:48:13 devstack sudo[96859]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 1073741824" returned: 0 in 0.564s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:13 devstack sudo[96865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3
Jul 17 03:48:13 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:14 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75e9505-e8ab-42e7-b7b3-10cc49f76837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bcf6c22-023e-4c4b-99f7-636b700147c3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f8ae20-d4dc-4902-a64a-a72dfe4452fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Volume volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 (8bcf6c22-023e-4c4b-99f7-636b700147c3): created successfully
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f8ae20-d4dc-4902-a64a-a72dfe4452fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (617b99ac-ab33-4b48-9b98-c9ce9346be28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-86b0229b-94eb-4c72-84d4-184214862079 tempest-VolumesSnapshotTestJSON-421476903 None] Created volume successfully.
Jul 17 03:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (a8466226-ddac-4072-be1a-c9c293497351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240f60ed-8bf5-4bba-80b7-c2ff828174bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240f60ed-8bf5-4bba-80b7-c2ff828174bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953592515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56304e03-a317-4222-8a4d-d14c0b6f2d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:15Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe513e47-9d6e-4bbf-8dbc-efc39d0c77d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe513e47-9d6e-4bbf-8dbc-efc39d0c77d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7624fe7-0aa6-422b-8f8e-ef14773ed0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7624fe7-0aa6-422b-8f8e-ef14773ed0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56304e03-a317-4222-8a4d-d14c0b6f2d0b', 'volume_name': 'volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a13824f-f190-498f-97dc-49cdf5cc960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a13824f-f190-498f-97dc-49cdf5cc960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c7f54a-db68-473b-9abc-9e3fee95dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume 56304e03-a317-4222-8a4d-d14c0b6f2d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b', 'volume_size': 1}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953592515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56304e03-a317-4222-8a4d-d14c0b6f2d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:15Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Creating volume 56304e03-a317-4222-8a4d-d14c0b6f2d0b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:15 devstack sudo[96871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b 1073741824
Jul 17 03:48:15 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (f5d6f78f-4201-4967-adbd-b286dbf26614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be3a231-31c4-4006-8309-5833f6480cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be3a231-31c4-4006-8309-5833f6480cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212512235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:16Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59840630-44f4-4c46-9863-e17ef5c8c698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59840630-44f4-4c46-9863-e17ef5c8c698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d502749-7a0c-4872-93e8-58e62d6cca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d502749-7a0c-4872-93e8-58e62d6cca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62', 'volume_name': 'volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f22db74-0e7e-4547-8b1f-3831bf73090f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f22db74-0e7e-4547-8b1f-3831bf73090f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7a4487-1197-4941-a304-6e7248d3a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume 610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62', 'volume_size': 1}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:16 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b 1073741824" returned: 0 in 0.820s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:16 devstack sudo[96877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b
Jul 17 03:48:16 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (24b8a1ec-acf2-488c-a90e-64def010e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555f5afe-c81b-4b77-97ee-d8077e22d0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555f5afe-c81b-4b77-97ee-d8077e22d0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368426509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e98bb28-904e-4f6d-8e67-961878d58011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:16Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa5608f-5caf-4d18-bd75-cf92b03c5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa5608f-5caf-4d18-bd75-cf92b03c5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7926eee9-f058-4704-a28f-3ed4bcb97c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7926eee9-f058-4704-a28f-3ed4bcb97c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e98bb28-904e-4f6d-8e67-961878d58011', 'volume_name': 'volume-5e98bb28-904e-4f6d-8e67-961878d58011', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35af3fa6-ed8d-4c40-a7ef-9e4420b6f6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35af3fa6-ed8d-4c40-a7ef-9e4420b6f6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfad6fe-6926-4b0f-8cf8-94a45cc9efb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume 5e98bb28-904e-4f6d-8e67-961878d58011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e98bb28-904e-4f6d-8e67-961878d58011', 'volume_size': 1}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:16 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b" returned: 0 in 0.495s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.725s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24c7f54a-db68-473b-9abc-9e3fee95dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5f692-2081-4943-8837-a2fff0310102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Creating offline snapshot 61e0292e-10bc-4eac-9ab5-421cbb5d3b3c of volume 8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25eba95-58c4-4b64-8dda-1b010d48a719]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b (56304e03-a317-4222-8a4d-d14c0b6f2d0b): created successfully
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5f692-2081-4943-8837-a2fff0310102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (a8466226-ddac-4072-be1a-c9c293497351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-994f94e0-9aa0-4bff-a754-c95315940f0e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created volume successfully.
Jul 17 03:48:16 devstack sudo[96880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3
Jul 17 03:48:16 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (28d0c78b-a24d-47ec-b342-95f644991cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d266f1e8-7e31-4ee3-953b-410dc185295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d266f1e8-7e31-4ee3-953b-410dc185295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1900451079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed77f3b-0377-42c6-8dc7-eb549712d919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:17Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca153722-0ba2-4e7f-934e-74ebd1b9ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca153722-0ba2-4e7f-934e-74ebd1b9ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f436a3e7-a537-44d3-9f0e-d10c37156927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f436a3e7-a537-44d3-9f0e-d10c37156927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed77f3b-0377-42c6-8dc7-eb549712d919', 'volume_name': 'volume-3ed77f3b-0377-42c6-8dc7-eb549712d919', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fa50f4-8a2b-49b5-a824-4af9d6cc91f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fa50f4-8a2b-49b5-a824-4af9d6cc91f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e63191f-948b-404a-9e07-bb851ad5a684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume 3ed77f3b-0377-42c6-8dc7-eb549712d919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed77f3b-0377-42c6-8dc7-eb549712d919', 'volume_size': 1}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:17 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (57344145-d859-4049-a6ee-4e98e40aab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faea5613-1974-4dd1-bdcc-b3acff5dc514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3" returned: 0 in 0.620s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faea5613-1974-4dd1-bdcc-b3acff5dc514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1190634144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524bf39c-79d9-44d4-83b6-50648738796f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:17Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257287a7-b8ee-475e-bc35-90f8f0629858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack sudo[96885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c 1G
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (257287a7-b8ee-475e-bc35-90f8f0629858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff79da7c-3ab9-406b-a571-9ba68a33323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff79da7c-3ab9-406b-a571-9ba68a33323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524bf39c-79d9-44d4-83b6-50648738796f', 'volume_name': 'volume-524bf39c-79d9-44d4-83b6-50648738796f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0198cb-55fc-4f81-9074-f8a9ef5ff952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0198cb-55fc-4f81-9074-f8a9ef5ff952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a46166-adff-4ae1-883e-cc45b563c62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume 524bf39c-79d9-44d4-83b6-50648738796f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524bf39c-79d9-44d4-83b6-50648738796f', 'volume_size': 1}
Jul 17 03:48:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:18 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c 1G" returned: 0 in 0.629s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:18 devstack sudo[96892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c
Jul 17 03:48:18 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:18 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:18 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c is being set with open permissions: ugo+rw
Jul 17 03:48:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:18 devstack sudo[96897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c
Jul 17 03:48:18 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:18 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:18 devstack sudo[96900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.info
Jul 17 03:48:18 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:19 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.info" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:19 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.info is being set with open permissions: ugo+rw
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:19 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.info
Jul 17 03:48:19 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:19 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.info" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.363s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-212512235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:16Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Creating volume 610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=183,cinder:UPDATE=251,cinder:INSERT=52,cinder:DELETE=19 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:48:19 devstack sudo[96906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 1073741824
Jul 17 03:48:19 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fb6376b8-c86f-4125-836c-c5ab5c0a1f7c tempest-VolumesSnapshotTestJSON-421476903 None] Create snapshot completed successfully
Jul 17 03:48:20 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 1073741824" returned: 0 in 0.614s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:20 devstack sudo[96912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62
Jul 17 03:48:20 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (51c81109-76b9-4836-a2bc-7155988052cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2cb1f5-dbae-4487-9de5-d2110967f48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2cb1f5-dbae-4487-9de5-d2110967f48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-401694829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=61e0292e-10bc-4eac-9ab5-421cbb5d3b3c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:20Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52011f51-17ea-4ca7-97f7-e22970c71a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52011f51-17ea-4ca7-97f7-e22970c71a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3cd7fe-5ee0-47ac-bf6a-60ff8286f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3cd7fe-5ee0-47ac-bf6a-60ff8286f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49', 'volume_name': 'volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49', 'volume_size': 2, 'snapshot_id': '61e0292e-10bc-4eac-9ab5-421cbb5d3b3c'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c75fc5d-48d7-457b-823b-c838d6923d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c75fc5d-48d7-457b-823b-c838d6923d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08702384-d50e-474d-a6e0-f9e62fd61a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Volume 7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49', 'volume_size': 2, 'snapshot_id': '61e0292e-10bc-4eac-9ab5-421cbb5d3b3c'}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:20 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.834s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368426509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e98bb28-904e-4f6d-8e67-961878d58011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:16Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Creating volume 5e98bb28-904e-4f6d-8e67-961878d58011 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:20 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011 1073741824
Jul 17 03:48:20 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7a4487-1197-4941-a304-6e7248d3a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69adf184-3e42-47be-8d7e-ca9fcabba13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 (610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62): created successfully
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69adf184-3e42-47be-8d7e-ca9fcabba13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (f5d6f78f-4201-4967-adbd-b286dbf26614) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a9f96af8-8db4-4131-b5a4-5f8f55e23112 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created volume successfully.
Jul 17 03:48:20 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011 1073741824" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:21 devstack sudo[96921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011
Jul 17 03:48:21 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:21 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.058s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1900451079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed77f3b-0377-42c6-8dc7-eb549712d919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:17Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Creating volume 3ed77f3b-0377-42c6-8dc7-eb549712d919 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfad6fe-6926-4b0f-8cf8-94a45cc9efb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e98bb28-904e-4f6d-8e67-961878d58011', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:21 devstack sudo[96924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919 1073741824
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b684948d-c3df-46f4-a33b-aba8e7907bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:21 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume volume-5e98bb28-904e-4f6d-8e67-961878d58011 (5e98bb28-904e-4f6d-8e67-961878d58011): created successfully
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b684948d-c3df-46f4-a33b-aba8e7907bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (24b8a1ec-acf2-488c-a90e-64def010e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a1cfbea8-d1c8-46f4-ac85-49e74d1a471b tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created volume successfully.
Jul 17 03:48:21 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919 1073741824" returned: 0 in 0.633s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:22 devstack sudo[96930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919
Jul 17 03:48:22 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:22 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.806s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1190634144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524bf39c-79d9-44d4-83b6-50648738796f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efdcb21904747a8aa061897a363d77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:17Z,use_quota=True,user_id='719f8afccfad49cf8e73ae87c5e7cb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Creating volume 524bf39c-79d9-44d4-83b6-50648738796f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e63191f-948b-404a-9e07-bb851ad5a684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed77f3b-0377-42c6-8dc7-eb549712d919', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e4900f-7f16-49e7-8252-aba4a8dc1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:22 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f 1073741824
Jul 17 03:48:22 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume volume-3ed77f3b-0377-42c6-8dc7-eb549712d919 (3ed77f3b-0377-42c6-8dc7-eb549712d919): created successfully
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0e4900f-7f16-49e7-8252-aba4a8dc1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (28d0c78b-a24d-47ec-b342-95f644991cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-acc1235b-04c8-40e9-8576-134ece83209d tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created volume successfully.
Jul 17 03:48:22 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f 1073741824" returned: 0 in 0.646s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:23 devstack sudo[96939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f
Jul 17 03:48:23 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:23 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.957s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a46166-adff-4ae1-883e-cc45b563c62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524bf39c-79d9-44d4-83b6-50648738796f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7d7b7e-ebe9-44d0-a5d5-093cf22e3902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Creating volume 7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 from snapshot 61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Volume volume-524bf39c-79d9-44d4-83b6-50648738796f (524bf39c-79d9-44d4-83b6-50648738796f): created successfully
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7d7b7e-ebe9-44d0-a5d5-093cf22e3902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Flow 'volume_create_manager' (57344145-d859-4049-a6ee-4e98e40aab62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ff29456b-6034-4ac3-ac3a-e164bf7c0c60 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created volume successfully.
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] snapshot: 61e0292e-10bc-4eac-9ab5-421cbb5d3b3c, volume: 7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b497194-5ee2-4c9d-8bcd-aa8a4bdbb86c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:23 devstack sudo[96942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c
Jul 17 03:48:23 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:23 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bcf6c22-023e-4c4b-99f7-636b700147c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ebdfb-af6b-4e5b-b874-07228a543453]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:24 devstack sudo[96948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3
Jul 17 03:48:24 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-524bf39c-79d9-44d4-83b6-50648738796f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-524bf39c-79d9-44d4-83b6-50648738796f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-quobyte-524bf39c-79d9-44d4-83b6-50648738796f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-524bf39c-79d9-44d4-83b6-50648738796f" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f1ae7-5dda-460d-81c3-4086232dd455]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:24 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:24 devstack sudo[96956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49
Jul 17 03:48:24 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:24 devstack sudo[96955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f
Jul 17 03:48:24 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:24 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:24 devstack sudo[96965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f
Jul 17 03:48:24 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:25 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-524bf39c-79d9-44d4-83b6-50648738796f" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-524bf39c-79d9-44d4-83b6-50648738796f" released by "delete_volume" :: held 1.027s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created reservations ['d9823559-5e1a-48ce-91d7-086788bec25d', 'fb13147c-26c2-4b83-a47d-2fb5870c7d00', '8eca00fe-1576-4ab7-b914-b5f81e43c76e', '0a746d19-f5d7-4a41-a203-6637eafc8514'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:25 devstack sudo[96975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:25 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:26 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.855s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Deleted volume successfully.
Jul 17 03:48:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89ffb0cd-0bbd-4b1d-8640-c831f051a165 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-524bf39c-79d9-44d4-83b6-50648738796f-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-3ed77f3b-0377-42c6-8dc7-eb549712d919-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-3ed77f3b-0377-42c6-8dc7-eb549712d919-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-quobyte-3ed77f3b-0377-42c6-8dc7-eb549712d919" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-3ed77f3b-0377-42c6-8dc7-eb549712d919" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95289592-e0a5-4ed3-a190-3feda073e8d0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:27 devstack sudo[96980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919
Jul 17 03:48:27 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:28 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919" returned: 0 in 1.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:28 devstack sudo[96985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919
Jul 17 03:48:28 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:29 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ed77f3b-0377-42c6-8dc7-eb549712d919" returned: 0 in 0.885s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-3ed77f3b-0377-42c6-8dc7-eb549712d919" released by "delete_volume" :: held 2.384s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created reservations ['08122833-bebe-4fe6-a8c8-b29f43cbc727', 'abf19319-56a2-42e0-82ed-638e9838e64f', '3d2cf4f5-ae4b-47b6-b738-0925db455918', '2ef61c06-3e3d-48cf-aba6-7a0f3b365f79'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:29 devstack sudo[96988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:29 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:30 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Deleted volume successfully.
Jul 17 03:48:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5cbe2dd0-8e53-4289-821d-eb763ae22dfb tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-3ed77f3b-0377-42c6-8dc7-eb549712d919-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-5e98bb28-904e-4f6d-8e67-961878d58011-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-5e98bb28-904e-4f6d-8e67-961878d58011-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-quobyte-5e98bb28-904e-4f6d-8e67-961878d58011" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-5e98bb28-904e-4f6d-8e67-961878d58011" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d1b589-62ba-472f-b5c4-110bce09c201]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:31 devstack sudo[96991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011
Jul 17 03:48:31 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:31 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" returned: 0 in 6.880s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf45bfd-9cb7-424c-b381-5c06903f01fa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:31 devstack sudo[96993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3
Jul 17 03:48:31 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:31 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011" returned: 0 in 0.668s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:31 devstack sudo[96998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011
Jul 17 03:48:31 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:32 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5e98bb28-904e-4f6d-8e67-961878d58011" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-5e98bb28-904e-4f6d-8e67-961878d58011" released by "delete_volume" :: held 1.192s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:32 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3" returned: 0 in 0.773s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:48:32 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Converted 1024.00 MB image at 148.81 MB/s
Jul 17 03:48:32 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 is being set with open permissions: ugo+rw
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:32 devstack sudo[97004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created reservations ['95ac6902-59b5-4b3e-a29a-096ba3fc7017', '26f68fb9-9a92-4885-a0c3-8f97387df1d8', 'd1d1143b-d109-4fa6-b845-07301a6fa01e', '710faac9-a704-4e9d-9d32-52c1942402bb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:32 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:32 devstack sudo[97006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:32 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:32 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" released by "_copy_volume_from_snapshot" :: held 9.058s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" released by "_create_volume_from_snapshot" :: held 9.130s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.167s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08702384-d50e-474d-a6e0-f9e62fd61a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49', 'volume_size': 2, 'snapshot_id': '61e0292e-10bc-4eac-9ab5-421cbb5d3b3c'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882d108d-8a01-458f-bfa9-5d5e08147318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Volume volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 (7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49): created successfully
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (882d108d-8a01-458f-bfa9-5d5e08147318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (51c81109-76b9-4836-a2bc-7155988052cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:32 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Deleted volume successfully.
Jul 17 03:48:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-579dc4e4-a202-43d6-baa2-d1c25cfab589 tempest-VolumesSnapshotTestJSON-421476903 None] Created volume successfully.
Jul 17 03:48:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3e1fc3d-08b1-46dd-9639-f4f9fed53035 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-5e98bb28-904e-4f6d-8e67-961878d58011-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-quobyte-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5b1f04-b790-4013-b2ee-3081d67d03e1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:33 devstack sudo[97010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62
Jul 17 03:48:33 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:33 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:33 devstack sudo[97049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62
Jul 17 03:48:33 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:33 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62" released by "delete_volume" :: held 0.891s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b03b0b2-2f0c-4bd3-9cba-f8cf640c1228]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created reservations ['fdf6b05e-e204-4d0b-b77a-bf518f566d2e', 'd129ada8-1876-4b42-929b-2700c528f0f4', '377b93ab-76d2-41b2-809d-ea0c212b46a4', '640627a2-4962-441b-bd24-f7955718fdd9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:34 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49
Jul 17 03:48:34 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:34 devstack sudo[97056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:34 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:34 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" returned: 0 in 0.507s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:34 devstack sudo[97061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49
Jul 17 03:48:34 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:34 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Deleted volume successfully.
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-91581b88-bb65-4dc7-a777-47fcdcc22ac8 tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-610a5dbf-3d6d-4b44-8a68-ca50ea0d8e62-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:34 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49" released by "delete_volume" :: held 0.918s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['c711b7b7-22db-42f1-b9a7-1ced354fb667', '75e93ff8-debc-4f08-a0cf-573f0f97516f', 'c7f7f11e-e455-4bd1-8583-4d16a014c67d', '02acb4fc-659b-4b9e-a2db-94c279bbb4bb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:35 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:35 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-8bcf6c22-023e-4c4b-99f7-636b700147c3" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-8bcf6c22-023e-4c4b-99f7-636b700147c3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Deleting offline snapshot 61e0292e-10bc-4eac-9ab5-421cbb5d3b3c of volume 8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] snapshot_file for this snap is: volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc366b4-ffa3-429e-878e-ee097805e4e3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-56304e03-a317-4222-8a4d-d14c0b6f2d0b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-56304e03-a317-4222-8a4d-d14c0b6f2d0b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-quobyte-56304e03-a317-4222-8a4d-d14c0b6f2d0b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-56304e03-a317-4222-8a4d-d14c0b6f2d0b" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e65c82-4766-45cf-bc7c-a1362ec48184]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:35 devstack sudo[97067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c
Jul 17 03:48:35 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:35 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Deleted volume successfully.
Jul 17 03:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df610eeb-7e9b-4a43-b92b-1fe5d6d2d514 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-7e8b232f-e7ba-4ea7-bd62-2f24d3d23d49-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:35 devstack sudo[97069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b
Jul 17 03:48:35 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:36 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:36 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" returned: 0 in 0.640s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bcf6c22-023e-4c4b-99f7-636b700147c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b" returned: 0 in 0.487s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8a2594-717f-416f-9727-01de3c75e2e6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:36 devstack sudo[97081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b
Jul 17 03:48:36 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:36 devstack sudo[97082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3
Jul 17 03:48:36 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:36 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56304e03-a317-4222-8a4d-d14c0b6f2d0b" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-56304e03-a317-4222-8a4d-d14c0b6f2d0b" released by "delete_volume" :: held 0.953s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:36 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created reservations ['b063b720-4adf-4fe5-b98b-c8ce1e914b1b', 'dabe9f17-03bc-4cb2-98ec-899bb605f355', 'f7f0da30-7a8a-440a-a7d8-6f5f5d775b03', 'a22cad20-2b04-4c6c-8418-d7c7fa9730a7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:36 devstack sudo[97090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c
Jul 17 03:48:36 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:36 devstack sudo[97092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:36 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:37 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Deleted volume successfully.
Jul 17 03:48:37 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a1ad58b-5cbd-41a8-9d74-8df8b69bcf3e tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-56304e03-a317-4222-8a4d-d14c0b6f2d0b-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:37 devstack sudo[97099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c
Jul 17 03:48:37 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:37 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3.61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c" released by "_delete_snapshot" :: held 2.119s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-8bcf6c22-023e-4c4b-99f7-636b700147c3" released by "delete_snapshot" :: held 2.152s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['bd3f147d-d64a-4c08-9696-dd780bab5d5b', 'c6b2822c-725c-4d40-afc1-2dcf1d2a1b01', 'c70b3219-82ac-4f70-91e3-de070ed5ecba', '4b843018-736e-4663-9b50-6a7f5d67dd35'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Delete snapshot completed successfully.
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-933b6c37-9d45-4ff3-8033-8d0e5af2784c tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-61e0292e-10bc-4eac-9ab5-421cbb5d3b3c-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-18de1947-150e-49f6-9761-a5ef3e007acd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-18de1947-150e-49f6-9761-a5ef3e007acd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "cinder-quobyte-18de1947-150e-49f6-9761-a5ef3e007acd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-18de1947-150e-49f6-9761-a5ef3e007acd" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b2468-ef4a-45f9-b3d8-992e1e983746]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:38 devstack sudo[97105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd
Jul 17 03:48:38 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:38 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:38 devstack sudo[97110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd
Jul 17 03:48:38 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-8bcf6c22-023e-4c4b-99f7-636b700147c3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-8bcf6c22-023e-4c4b-99f7-636b700147c3-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-8bcf6c22-023e-4c4b-99f7-636b700147c3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:38 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-18de1947-150e-49f6-9761-a5ef3e007acd" returned: 0 in 0.547s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-8bcf6c22-023e-4c4b-99f7-636b700147c3" acquired by "delete_volume" :: waited 0.056s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-quobyte-18de1947-150e-49f6-9761-a5ef3e007acd" released by "delete_volume" :: held 1.107s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d994663-b9a9-4f2a-b6db-84a8adb08cab]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Created reservations ['bbd21c5e-f695-4ad1-b93e-6407c1cd5ebb', '8c6ecc6b-a0f8-4e77-a4a4-586da70f3843', '8a8ca28e-f039-4886-861b-6eb469c8b148', 'b1ed7f68-5bdb-49ba-82b3-3e2c2ef301d0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:39 devstack sudo[97113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3
Jul 17 03:48:39 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:39 devstack sudo[97115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:39 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:39 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:39 devstack sudo[97120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3
Jul 17 03:48:39 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:39 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Deleted volume successfully.
Jul 17 03:48:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f73cb22a-0864-4654-9ef7-b133641bf61c tempest-CreateVolumesFromSourceVolumeTest-1963860370 None] Lock "cinder-18de1947-150e-49f6-9761-a5ef3e007acd-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:40 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bcf6c22-023e-4c4b-99f7-636b700147c3" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-8bcf6c22-023e-4c4b-99f7-636b700147c3" released by "delete_volume" :: held 1.136s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['b76e448d-a048-47c2-ada3-6d7d9b5d0242', '4f257405-7f48-40ad-b0b4-beaa2107b12c', '7d34d176-283a-484d-98e8-481552bd6fa8', '637df0db-5364-44f5-a9b6-a8e620928122'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:40 devstack sudo[97128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:48:40 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:40 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:48:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Deleted volume successfully.
Jul 17 03:48:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1bc7cd0-6d51-47d0-a4b5-24a086c0a7a4 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-8bcf6c22-023e-4c4b-99f7-636b700147c3-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (79cb558c-ff90-4294-b9ab-ccb117c57642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdde485-cc85-4bf9-aa7b-101e75c07f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdde485-cc85-4bf9-aa7b-101e75c07f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1652357459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2468005-ccef-4fbe-96f3-73eab164eac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:42Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec85dde9-0a19-46b5-ac60-a9db1e7de93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec85dde9-0a19-46b5-ac60-a9db1e7de93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20d71a8-2731-47ed-97b7-895303f1bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20d71a8-2731-47ed-97b7-895303f1bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2468005-ccef-4fbe-96f3-73eab164eac0', 'volume_name': 'volume-a2468005-ccef-4fbe-96f3-73eab164eac0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7504fc-8c3d-4e76-9f60-5c62af389fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7504fc-8c3d-4e76-9f60-5c62af389fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6526870b-94a9-4848-98b2-ac1c99f774bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Volume a2468005-ccef-4fbe-96f3-73eab164eac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2468005-ccef-4fbe-96f3-73eab164eac0', 'volume_size': 1}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1652357459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2468005-ccef-4fbe-96f3-73eab164eac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:42Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Creating volume a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:41 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:48:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:41 devstack sudo[97146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 1073741824
Jul 17 03:48:41 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:42 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 1073741824" returned: 0 in 0.587s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:42 devstack sudo[97153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0
Jul 17 03:48:42 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:42 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6526870b-94a9-4848-98b2-ac1c99f774bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2468005-ccef-4fbe-96f3-73eab164eac0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b65e97-dae3-47f3-bd92-17a7d291874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Volume volume-a2468005-ccef-4fbe-96f3-73eab164eac0 (a2468005-ccef-4fbe-96f3-73eab164eac0): created successfully
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93b65e97-dae3-47f3-bd92-17a7d291874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (79cb558c-ff90-4294-b9ab-ccb117c57642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e2d0b654-1a07-4f60-b60b-c18d77143be9 tempest-VolumesSnapshotTestJSON-421476903 None] Created volume successfully.
Jul 17 03:48:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Creating offline snapshot ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 of volume a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:48:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[49756d0f-cc3a-4b51-8221-453cbc7bff56]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:44 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0
Jul 17 03:48:44 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:45 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0" returned: 0 in 0.700s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:45 devstack sudo[97228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 1G
Jul 17 03:48:45 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:45 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 1G" returned: 0 in 0.823s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2468005-ccef-4fbe-96f3-73eab164eac0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:45 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2468005-ccef-4fbe-96f3-73eab164eac0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555
Jul 17 03:48:45 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:46 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2468005-ccef-4fbe-96f3-73eab164eac0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:46 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 is being set with open permissions: ugo+rw
Jul 17 03:48:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:46 devstack sudo[97244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555
Jul 17 03:48:46 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:46 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" returned: 0 in 0.563s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:47 devstack sudo[97247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.info
Jul 17 03:48:47 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:47 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.info" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:47 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.info is being set with open permissions: ugo+rw
Jul 17 03:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:47 devstack sudo[97250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.info
Jul 17 03:48:47 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:47 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.info" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.814s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:48 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=200,cinder:SELECT=169,cinder:DELETE=19,cinder:INSERT=58 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:48:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f251df59-2048-4ca3-973e-87fc9ba2f18a tempest-VolumesSnapshotTestJSON-421476903 None] Create snapshot completed successfully
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (e12efbf1-9657-41e9-b046-6b62449ffa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc484bf2-2cf3-4e7c-9400-eb658d49bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc484bf2-2cf3-4e7c-9400-eb658d49bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1418987537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e575089d-6dcd-4037-87db-0f304f87d65a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bd986aedcf44b2b2ea942b0c128dab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed691cdc-3b9d-4572-aeed-0c9b2c0a1555,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:48:49Z,use_quota=True,user_id='c01508294abe49ddb5e6a10f8870f300',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b845017-1036-4226-a6d9-19c8ee9f8214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b845017-1036-4226-a6d9-19c8ee9f8214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97efc81-1207-4a6c-8e35-da2e45c71ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97efc81-1207-4a6c-8e35-da2e45c71ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e575089d-6dcd-4037-87db-0f304f87d65a', 'volume_name': 'volume-e575089d-6dcd-4037-87db-0f304f87d65a', 'volume_size': 1, 'snapshot_id': 'ed691cdc-3b9d-4572-aeed-0c9b2c0a1555'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27352d40-072d-4de2-b3c9-5c184cc5b390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27352d40-072d-4de2-b3c9-5c184cc5b390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e0218b-dd57-4176-ae3a-87fbf8be8cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:48:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Volume e575089d-6dcd-4037-87db-0f304f87d65a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e575089d-6dcd-4037-87db-0f304f87d65a', 'volume_size': 1, 'snapshot_id': 'ed691cdc-3b9d-4572-aeed-0c9b2c0a1555'}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555-e575089d-6dcd-4037-87db-0f304f87d65a" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555-e575089d-6dcd-4037-87db-0f304f87d65a" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Creating volume e575089d-6dcd-4037-87db-0f304f87d65a from snapshot ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-e575089d-6dcd-4037-87db-0f304f87d65a" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-e575089d-6dcd-4037-87db-0f304f87d65a" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] snapshot: ed691cdc-3b9d-4572-aeed-0c9b2c0a1555, volume: e575089d-6dcd-4037-87db-0f304f87d65a,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf98ced8-32b8-4a83-8269-a78ff9117bb3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:50 devstack sudo[97274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555
Jul 17 03:48:50 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:50 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" returned: 0 in 0.566s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2468005-ccef-4fbe-96f3-73eab164eac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:48:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:48:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:48:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f621f0-0071-4045-b82c-8eeaed992449]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:48:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:50 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0
Jul 17 03:48:50 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:51 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Jul 17 03:48:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0" returned: 0 in 0.490s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:48:51 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:48:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:48:51 devstack sudo[97287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a
Jul 17 03:48:51 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:48:59 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=57,cinder:UPDATE=88,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:48:59 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:49:00 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a" returned: 0 in 9.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a2d40b-c3bf-46c1-a14e-514a09112ce6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:00 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0
Jul 17 03:49:00 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:01 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0" returned: 0 in 0.759s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:49:01 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Converted 1024.00 MB image at 108.58 MB/s
Jul 17 03:49:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a is being set with open permissions: ugo+rw
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:01 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a
Jul 17 03:49:01 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:01 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-e575089d-6dcd-4037-87db-0f304f87d65a" released by "_copy_volume_from_snapshot" :: held 11.877s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555-e575089d-6dcd-4037-87db-0f304f87d65a" released by "_create_volume_from_snapshot" :: held 11.934s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.971s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e0218b-dd57-4176-ae3a-87fbf8be8cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e575089d-6dcd-4037-87db-0f304f87d65a', 'volume_size': 1, 'snapshot_id': 'ed691cdc-3b9d-4572-aeed-0c9b2c0a1555'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd59b121-ef83-4a4a-8777-9309a4fb9a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Volume volume-e575089d-6dcd-4037-87db-0f304f87d65a (e575089d-6dcd-4037-87db-0f304f87d65a): created successfully
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd59b121-ef83-4a4a-8777-9309a4fb9a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Flow 'volume_create_manager' (e12efbf1-9657-41e9-b046-6b62449ffa11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c1ff5f68-6f75-42d3-a3b9-a884d48a8545 tempest-VolumesSnapshotTestJSON-421476903 None] Created volume successfully.
Jul 17 03:49:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-e575089d-6dcd-4037-87db-0f304f87d65a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-e575089d-6dcd-4037-87db-0f304f87d65a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-e575089d-6dcd-4037-87db-0f304f87d65a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-e575089d-6dcd-4037-87db-0f304f87d65a" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9346a97-a2ee-468e-bae6-e271037d2bc9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:03 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a
Jul 17 03:49:03 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:03 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:03 devstack sudo[97414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a
Jul 17 03:49:03 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:03 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e575089d-6dcd-4037-87db-0f304f87d65a" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-e575089d-6dcd-4037-87db-0f304f87d65a" released by "delete_volume" :: held 0.778s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['1e17d68e-c11e-48fd-b559-0d5da3d30965', '746f4d92-f36c-447b-b4b5-ba47043a4659', '8530eca2-a9e1-459e-8f28-0e043f4d90da', 'a6cf78d3-022c-4ae7-8b8b-176a2b10ce31'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:03 devstack sudo[97417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:49:03 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-a2468005-ccef-4fbe-96f3-73eab164eac0" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-a2468005-ccef-4fbe-96f3-73eab164eac0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Deleting offline snapshot ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 of volume a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:49:04 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] snapshot_file for this snap is: volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:49:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Deleted volume successfully.
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f334941f-1f66-43a4-8ab7-f00c3808804d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7f0f2e1-ae18-4248-a2a5-aa9fe379ae37 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-e575089d-6dcd-4037-87db-0f304f87d65a-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:04 devstack sudo[97420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555
Jul 17 03:49:04 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:04 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2468005-ccef-4fbe-96f3-73eab164eac0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c3260-209b-4598-a1ab-30ec2ee34a65]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:05 devstack sudo[97427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0
Jul 17 03:49:05 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:05 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0" returned: 0 in 0.563s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:05 devstack sudo[97433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555
Jul 17 03:49:05 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:05 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:06 devstack sudo[97439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555
Jul 17 03:49:06 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:06 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0.ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" returned: 0 in 0.620s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555" released by "_delete_snapshot" :: held 2.439s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-a2468005-ccef-4fbe-96f3-73eab164eac0" released by "delete_snapshot" :: held 2.508s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['f02c3518-cd8b-4413-8fc8-c1342a03a497', 'c07a40b2-05b8-4d5b-8d1e-03182ae87cdc', '26cf4ccd-0ce6-4f3d-b6a2-1101fbb24814', '6df3daa9-9cc7-494b-ae0f-b5d095e20cf6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Delete snapshot completed successfully.
Jul 17 03:49:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa129ff-58ab-4bd4-a733-e696897e21b9 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-ed691cdc-3b9d-4572-aeed-0c9b2c0a1555-delete_snapshot" released by "delete_snapshot" :: held 2.802s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-a2468005-ccef-4fbe-96f3-73eab164eac0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-a2468005-ccef-4fbe-96f3-73eab164eac0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-a2468005-ccef-4fbe-96f3-73eab164eac0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-a2468005-ccef-4fbe-96f3-73eab164eac0" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec2bd7b-5360-45ef-9591-52f8ab6614d8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:07 devstack sudo[97444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0
Jul 17 03:49:07 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:08 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:08 devstack sudo[97449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0
Jul 17 03:49:08 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:08 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a2468005-ccef-4fbe-96f3-73eab164eac0" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-a2468005-ccef-4fbe-96f3-73eab164eac0" released by "delete_volume" :: held 1.073s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['a5ba61f3-e936-4eef-9ff7-967e6e838412', 'f23d168e-4041-4b98-9b04-c3511e035f19', '55cdd8bd-6f1f-4f39-b594-5d18a80fd34f', '8b89df11-9e5f-4b9d-ac1c-c31a02086de3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:09 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:49:09 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Flow 'volume_create_manager' (53b8e087-081e-40c5-bb7a-980fe05058a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86eacbee-8927-4d7f-bb66-fa1bacdd1805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86eacbee-8927-4d7f-bb66-fa1bacdd1805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-774783301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8878a286-a791-4954-8f7b-9a95ec9123a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0580f81ad5e349699d33d081fe5f0225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:09Z,use_quota=True,user_id='bd1abae7d2ce428999a9dabf8ba6a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62c7f3d-8784-4985-816e-e85f5af58c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62c7f3d-8784-4985-816e-e85f5af58c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b21e90-94d7-4297-926b-d8ac1101497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57b21e90-94d7-4297-926b-d8ac1101497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8878a286-a791-4954-8f7b-9a95ec9123a8', 'volume_name': 'volume-8878a286-a791-4954-8f7b-9a95ec9123a8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649dd34d-15e8-438a-9db1-cca67c512a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649dd34d-15e8-438a-9db1-cca67c512a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df08bc36-81b9-4b2f-abe5-dda161046cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Volume 8878a286-a791-4954-8f7b-9a95ec9123a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8878a286-a791-4954-8f7b-9a95ec9123a8', 'volume_size': 1}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-774783301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8878a286-a791-4954-8f7b-9a95ec9123a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0580f81ad5e349699d33d081fe5f0225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:09Z,use_quota=True,user_id='bd1abae7d2ce428999a9dabf8ba6a188',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Creating volume 8878a286-a791-4954-8f7b-9a95ec9123a8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:49:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:09 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8 1073741824
Jul 17 03:49:09 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:09 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:49:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Deleted volume successfully.
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87080ef0-b2a0-41b1-9ac0-9a8382008852 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-a2468005-ccef-4fbe-96f3-73eab164eac0-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:09 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8 1073741824" returned: 0 in 0.604s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:10 devstack sudo[97494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8
Jul 17 03:49:10 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-b6dff4b9-9efb-4bba-90bc-8c945c1e6897-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-b6dff4b9-9efb-4bba-90bc-8c945c1e6897-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "cinder-quobyte-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d516ab39-e442-4c9e-bb03-98bd38a6ef41]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:10 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df08bc36-81b9-4b2f-abe5-dda161046cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8878a286-a791-4954-8f7b-9a95ec9123a8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:10 devstack sudo[97496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897
Jul 17 03:49:10 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331b3e6b-dd70-4820-adf9-49705222c9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Volume volume-8878a286-a791-4954-8f7b-9a95ec9123a8 (8878a286-a791-4954-8f7b-9a95ec9123a8): created successfully
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331b3e6b-dd70-4820-adf9-49705222c9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Flow 'volume_create_manager' (53b8e087-081e-40c5-bb7a-980fe05058a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d1fe3a13-2ea0-4aab-86ff-d910a3ace6b4 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Created volume successfully.
Jul 17 03:49:10 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:10 devstack sudo[97502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897
Jul 17 03:49:10 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:10 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-quobyte-b6dff4b9-9efb-4bba-90bc-8c945c1e6897" released by "delete_volume" :: held 0.717s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Created reservations ['731dd99c-09f3-40f0-bf0f-0f015d9f0dac', '5a22c4f8-716a-458d-af89-d399e6f8f345', 'ae6e2ada-5220-4a6c-9e10-f0e7d8887c66', '207b3f2a-fad0-4b35-b7c2-502a2e869bce'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:11 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:49:11 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:11 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:49:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Deleted volume successfully.
Jul 17 03:49:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9d0723d0-5a7b-47c3-871c-32e0a7c702c6 tempest-VolumesSnapshotTestJSON-421476903 None] Lock "cinder-b6dff4b9-9efb-4bba-90bc-8c945c1e6897-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b134cd6b-e93e-43f1-ac5f-d1b173d53387 req-ddc27350-6954-4ebf-849c-eaa8affc2042 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b134cd6b-e93e-43f1-ac5f-d1b173d53387 req-ddc27350-6954-4ebf-849c-eaa8affc2042 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b134cd6b-e93e-43f1-ac5f-d1b173d53387 req-ddc27350-6954-4ebf-849c-eaa8affc2042 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-b134cd6b-e93e-43f1-ac5f-d1b173d53387 req-ddc27350-6954-4ebf-849c-eaa8affc2042 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-8878a286-a791-4954-8f7b-9a95ec9123a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b55b326-927c-45e5-af39-383f2bc9ce79', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:49:12 devstack sudo[97519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:49:12 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-b134cd6b-e93e-43f1-ac5f-d1b173d53387 req-ddc27350-6954-4ebf-849c-eaa8affc2042 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] attachment_update completed successfully.
Jul 17 03:49:12 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:49:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-23a97980-5a8a-4d81-a881-a49e4f351c63 req-e3d66d6a-9c76-4849-b31c-b79da3bec3b7 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Terminate volume connection completed successfully.
Jul 17 03:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-23a97980-5a8a-4d81-a881-a49e4f351c63 req-e3d66d6a-9c76-4849-b31c-b79da3bec3b7 tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Deleting attachment 7b55b326-927c-45e5-af39-383f2bc9ce79. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:49:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Acquiring lock "cinder-8878a286-a791-4954-8f7b-9a95ec9123a8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "cinder-8878a286-a791-4954-8f7b-9a95ec9123a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Acquiring lock "cinder-quobyte-8878a286-a791-4954-8f7b-9a95ec9123a8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "cinder-quobyte-8878a286-a791-4954-8f7b-9a95ec9123a8" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[399e21ff-9241-4253-9925-20c15fab7f50]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:17 devstack sudo[97935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8
Jul 17 03:49:17 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:18 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8" returned: 0 in 0.553s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:18 devstack sudo[97941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8
Jul 17 03:49:18 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:18 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8878a286-a791-4954-8f7b-9a95ec9123a8" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "cinder-quobyte-8878a286-a791-4954-8f7b-9a95ec9123a8" released by "delete_volume" :: held 0.911s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Created reservations ['57cfe458-ad54-40e2-be52-2ce1a5464a14', '4d89cd47-2d76-4b75-a2fd-224e0bf9302d', '7137d7c6-cccf-41be-9a35-ceb5eb6ea792', '1ab382f6-d789-45a8-aad0-2914b0b411b5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:18 devstack sudo[97944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:49:18 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:18 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:18 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:49:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Deleted volume successfully.
Jul 17 03:49:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e3966769-c1af-437a-96fb-51efa17de59a tempest-TestServerVolumeAttachScenarioOldVersion-560631798 None] Lock "cinder-8878a286-a791-4954-8f7b-9a95ec9123a8-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Flow 'volume_create_manager' (d2b2db9c-ac8c-4aea-9511-59b21f5276c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ef512-08e9-4fed-bd79-fec88c1b0e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ef512-08e9-4fed-bd79-fec88c1b0e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1603093485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccb6c50-647a-4262-92ea-d735637e11e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2e8c1fc224bcfa31b6fc2d83a4cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:22Z,use_quota=True,user_id='558a46a330bd4cdcad020e32e3b57aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076f6456-929d-495c-9734-8cd9eca31289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076f6456-929d-495c-9734-8cd9eca31289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ef28e5-7db7-4412-bc53-b3a3ce747d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ef28e5-7db7-4412-bc53-b3a3ce747d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ccb6c50-647a-4262-92ea-d735637e11e4', 'volume_name': 'volume-7ccb6c50-647a-4262-92ea-d735637e11e4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f411e764-b8a8-421d-b8fb-928007e63c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f411e764-b8a8-421d-b8fb-928007e63c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2da5404-e751-47b0-ad78-6a2d06bf63e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Volume 7ccb6c50-647a-4262-92ea-d735637e11e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ccb6c50-647a-4262-92ea-d735637e11e4', 'volume_size': 1}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1603093485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ccb6c50-647a-4262-92ea-d735637e11e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2e8c1fc224bcfa31b6fc2d83a4cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:22Z,use_quota=True,user_id='558a46a330bd4cdcad020e32e3b57aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Creating volume 7ccb6c50-647a-4262-92ea-d735637e11e4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:49:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:22 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4 1073741824
Jul 17 03:49:22 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:23 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4 1073741824" returned: 0 in 0.590s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:23 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4
Jul 17 03:49:23 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Flow 'volume_create_manager' (ac207af4-0775-4e70-b31d-fbc45b93d4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:23 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767a53e3-2141-4a0f-88b8-0ce230717e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4" returned: 0 in 0.649s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767a53e3-2141-4a0f-88b8-0ce230717e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-629220835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0065e137-e268-42cc-b7c1-b9ccee8275c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6cb40f82d54404a178f439b4b53a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:24Z,use_quota=True,user_id='f5e31930bcfd44e49646e3132e322d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a310b5cc-d5a8-4078-b2da-9715cd235b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a310b5cc-d5a8-4078-b2da-9715cd235b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bbdfcf-d2fe-42c9-9c13-b22956632da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47bbdfcf-d2fe-42c9-9c13-b22956632da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0065e137-e268-42cc-b7c1-b9ccee8275c8', 'volume_name': 'volume-0065e137-e268-42cc-b7c1-b9ccee8275c8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ff9457-1c8f-414a-a1f1-b3f25c9652ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ff9457-1c8f-414a-a1f1-b3f25c9652ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f202ca-bf0f-4354-a6d6-53ffefea4f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Volume 0065e137-e268-42cc-b7c1-b9ccee8275c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0065e137-e268-42cc-b7c1-b9ccee8275c8', 'volume_size': 1}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-629220835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0065e137-e268-42cc-b7c1-b9ccee8275c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6cb40f82d54404a178f439b4b53a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:24Z,use_quota=True,user_id='f5e31930bcfd44e49646e3132e322d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Creating volume 0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:49:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2da5404-e751-47b0-ad78-6a2d06bf63e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ccb6c50-647a-4262-92ea-d735637e11e4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8935f9a-6bbc-4fb4-ba68-7d33cb1e74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:23 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 1073741824
Jul 17 03:49:23 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Volume volume-7ccb6c50-647a-4262-92ea-d735637e11e4 (7ccb6c50-647a-4262-92ea-d735637e11e4): created successfully
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8935f9a-6bbc-4fb4-ba68-7d33cb1e74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Flow 'volume_create_manager' (d2b2db9c-ac8c-4aea-9511-59b21f5276c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-326de46d-b19d-4421-8e75-b00c79bc9e89 tempest-AttachVolumeNegativeTest-559320827 None] Created volume successfully.
Jul 17 03:49:24 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 1073741824" returned: 0 in 0.659s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:24 devstack sudo[97989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8
Jul 17 03:49:24 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:24 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f202ca-bf0f-4354-a6d6-53ffefea4f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0065e137-e268-42cc-b7c1-b9ccee8275c8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da146c6e-314f-4113-8bfb-1c8d5e57b777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Volume volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 (0065e137-e268-42cc-b7c1-b9ccee8275c8): created successfully
Jul 17 03:49:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da146c6e-314f-4113-8bfb-1c8d5e57b777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Flow 'volume_create_manager' (ac207af4-0775-4e70-b31d-fbc45b93d4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3e585b90-4e66-4de7-8a6b-8b4c21c2e739 tempest-SnapshotDependencyTests-1861625650 None] Created volume successfully.
Jul 17 03:49:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1bfae294-cfba-4c5c-8894-779a94c05527 req-869dd4df-2870-46f2-ac58-a06674965c98 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1bfae294-cfba-4c5c-8894-779a94c05527 req-869dd4df-2870-46f2-ac58-a06674965c98 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1bfae294-cfba-4c5c-8894-779a94c05527 req-869dd4df-2870-46f2-ac58-a06674965c98 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-1bfae294-cfba-4c5c-8894-779a94c05527 req-869dd4df-2870-46f2-ac58-a06674965c98 tempest-AttachVolumeNegativeTest-559320827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-7ccb6c50-647a-4262-92ea-d735637e11e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16033963-844a-47c4-95a7-953b8d15e84f', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:49:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-1bfae294-cfba-4c5c-8894-779a94c05527 req-869dd4df-2870-46f2-ac58-a06674965c98 tempest-AttachVolumeNegativeTest-559320827 None] attachment_update completed successfully.
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Creating offline snapshot b3333251-bbf3-4530-8e2f-4fed0bd24160 of volume 0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[491e2f80-9314-489e-ae44-d56c785cbf56]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:26 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8
Jul 17 03:49:26 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:26 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:26 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 1G
Jul 17 03:49:26 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:27 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 1G" returned: 0 in 0.581s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:27 devstack sudo[98407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160
Jul 17 03:49:27 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:27 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:27 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 is being set with open permissions: ugo+rw
Jul 17 03:49:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:27 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160
Jul 17 03:49:27 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:28 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:28 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.info
Jul 17 03:49:28 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:28 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.info" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:28 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.info is being set with open permissions: ugo+rw
Jul 17 03:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:28 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.info
Jul 17 03:49:28 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:28 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.info" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a614852e-4121-4115-b18a-6aa8cee670fc tempest-SnapshotDependencyTests-1861625650 None] Create snapshot completed successfully
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Flow 'volume_create_manager' (9ad47d6e-9a29-4f1a-a0d1-50d765a3a0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6954d9-8a5f-43fe-9581-6ccb39be3172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6954d9-8a5f-43fe-9581-6ccb39be3172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06bc9a1-70bd-462f-804b-6448ed87e96a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c6cb40f82d54404a178f439b4b53a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b3333251-bbf3-4530-8e2f-4fed0bd24160,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:30Z,use_quota=True,user_id='f5e31930bcfd44e49646e3132e322d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef1a295-8f96-42b2-822d-d3b0c9a7bc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef1a295-8f96-42b2-822d-d3b0c9a7bc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435cdeda-e679-4167-8c6f-f1ee969ff704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435cdeda-e679-4167-8c6f-f1ee969ff704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e06bc9a1-70bd-462f-804b-6448ed87e96a', 'volume_name': 'volume-e06bc9a1-70bd-462f-804b-6448ed87e96a', 'volume_size': 1, 'snapshot_id': 'b3333251-bbf3-4530-8e2f-4fed0bd24160'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb9b2db-15c4-4777-aef2-952ccb32ee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccb9b2db-15c4-4777-aef2-952ccb32ee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed09f0d-0b4c-4701-9f97-81f7ee7c26ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Volume e06bc9a1-70bd-462f-804b-6448ed87e96a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e06bc9a1-70bd-462f-804b-6448ed87e96a', 'volume_size': 1, 'snapshot_id': 'b3333251-bbf3-4530-8e2f-4fed0bd24160'}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-quobyte-b3333251-bbf3-4530-8e2f-4fed0bd24160-e06bc9a1-70bd-462f-804b-6448ed87e96a" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-b3333251-bbf3-4530-8e2f-4fed0bd24160-e06bc9a1-70bd-462f-804b-6448ed87e96a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Creating volume e06bc9a1-70bd-462f-804b-6448ed87e96a from snapshot b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-quobyte-e06bc9a1-70bd-462f-804b-6448ed87e96a" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-e06bc9a1-70bd-462f-804b-6448ed87e96a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] snapshot: b3333251-bbf3-4530-8e2f-4fed0bd24160, volume: e06bc9a1-70bd-462f-804b-6448ed87e96a,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a5d93b-50c0-45ee-b9c0-676e3201b2d8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:30 devstack sudo[98422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160
Jul 17 03:49:30 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:31 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0065e137-e268-42cc-b7c1-b9ccee8275c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2650b4-ae63-4b2c-89af-4bdc75814052]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:31 devstack sudo[98427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8
Jul 17 03:49:31 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:31 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:31 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a
Jul 17 03:49:31 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:37 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a" returned: 0 in 5.787s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de62d5-1265-47b6-a799-ebb8d5dccb6b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:37 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8
Jul 17 03:49:37 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:37 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8" returned: 0 in 0.606s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:37 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:49:37 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Converted 1024.00 MB image at 176.92 MB/s
Jul 17 03:49:37 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a is being set with open permissions: ugo+rw
Jul 17 03:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:37 devstack sudo[98489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a
Jul 17 03:49:37 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:38 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-e06bc9a1-70bd-462f-804b-6448ed87e96a" released by "_copy_volume_from_snapshot" :: held 7.708s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-b3333251-bbf3-4530-8e2f-4fed0bd24160-e06bc9a1-70bd-462f-804b-6448ed87e96a" released by "_create_volume_from_snapshot" :: held 7.748s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.763s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed09f0d-0b4c-4701-9f97-81f7ee7c26ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06bc9a1-70bd-462f-804b-6448ed87e96a', 'volume_size': 1, 'snapshot_id': 'b3333251-bbf3-4530-8e2f-4fed0bd24160'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0abfe1-4a4b-4f63-872e-37a57b07481f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Volume volume-e06bc9a1-70bd-462f-804b-6448ed87e96a (e06bc9a1-70bd-462f-804b-6448ed87e96a): created successfully
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0abfe1-4a4b-4f63-872e-37a57b07481f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Flow 'volume_create_manager' (9ad47d6e-9a29-4f1a-a0d1-50d765a3a0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6579f4ca-d654-44f8-9183-16b8732c87b0 tempest-SnapshotDependencyTests-1861625650 None] Created volume successfully.
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-b3333251-bbf3-4530-8e2f-4fed0bd24160-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-b3333251-bbf3-4530-8e2f-4fed0bd24160-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-quobyte-0065e137-e268-42cc-b7c1-b9ccee8275c8" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-0065e137-e268-42cc-b7c1-b9ccee8275c8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-quobyte-b3333251-bbf3-4530-8e2f-4fed0bd24160" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-b3333251-bbf3-4530-8e2f-4fed0bd24160" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Deleting offline snapshot b3333251-bbf3-4530-8e2f-4fed0bd24160 of volume 0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] snapshot_file for this snap is: volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed89655-92e9-472c-8a19-ffc0bafe9ec9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:39 devstack sudo[98493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160
Jul 17 03:49:39 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:40 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0065e137-e268-42cc-b7c1-b9ccee8275c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:49:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a209ee1-eaf3-4eaa-8354-0612a0f7fd17]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:40 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8
Jul 17 03:49:40 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:40 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8" returned: 0 in 0.483s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:40 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160
Jul 17 03:49:40 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:41 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160" returned: 0 in 0.466s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:41 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160
Jul 17 03:49:41 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:41 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8.b3333251-bbf3-4530-8e2f-4fed0bd24160" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-b3333251-bbf3-4530-8e2f-4fed0bd24160" released by "_delete_snapshot" :: held 1.989s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-0065e137-e268-42cc-b7c1-b9ccee8275c8" released by "delete_snapshot" :: held 2.029s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Created reservations ['ae4acb61-6258-4745-8600-a5c2a7d2a278', 'e603f10f-a62c-45dd-9f43-4abce82c6ffa', '5468dc2d-d04c-415c-8455-f1f2fdf53128', '46492064-d039-41ca-b7e8-11f7173eb5de'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Delete snapshot completed successfully.
Jul 17 03:49:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7572e182-80f2-4d85-b2b1-a2baaf8d3a24 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-b3333251-bbf3-4530-8e2f-4fed0bd24160-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-0065e137-e268-42cc-b7c1-b9ccee8275c8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-0065e137-e268-42cc-b7c1-b9ccee8275c8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-quobyte-0065e137-e268-42cc-b7c1-b9ccee8275c8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-0065e137-e268-42cc-b7c1-b9ccee8275c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee3a53-feaa-4b76-8a57-05bb82064ee6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:43 devstack sudo[98534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8
Jul 17 03:49:43 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:43 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:43 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8
Jul 17 03:49:43 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:43 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0065e137-e268-42cc-b7c1-b9ccee8275c8" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-0065e137-e268-42cc-b7c1-b9ccee8275c8" released by "delete_volume" :: held 0.884s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Created reservations ['28b8de09-6369-45eb-8a28-91dcd7666bf7', 'a91d5667-b25f-4fab-a16c-19e859986d5f', '2067699c-4bff-48b8-ab7d-d04007ea97d3', '7768a999-7ec3-4a52-a98a-8bb1a229b692'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:44 devstack sudo[98542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:49:44 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-e06bc9a1-70bd-462f-804b-6448ed87e96a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-e06bc9a1-70bd-462f-804b-6448ed87e96a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "cinder-quobyte-e06bc9a1-70bd-462f-804b-6448ed87e96a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-e06bc9a1-70bd-462f-804b-6448ed87e96a" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cb3845-a91c-4ca1-9194-886c2c9de7bb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:44 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:49:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Deleted volume successfully.
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cbb8b033-208c-4d3e-8ee5-b80f39567afc tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-0065e137-e268-42cc-b7c1-b9ccee8275c8-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:44 devstack sudo[98544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a
Jul 17 03:49:44 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:44 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a" returned: 0 in 0.552s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:44 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a
Jul 17 03:49:44 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:45 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e06bc9a1-70bd-462f-804b-6448ed87e96a" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-quobyte-e06bc9a1-70bd-462f-804b-6448ed87e96a" released by "delete_volume" :: held 1.061s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Created reservations ['aa305654-6e67-42a9-bc8a-d12a42c55d72', '7d00aaa4-91d9-41ae-b76a-8aa646ce55bd', 'e7bc79e5-136c-4b72-b717-a72321c919eb', '6cffbc46-9b6e-4e4d-9730-c7401caafc49'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:45 devstack sudo[98553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:49:45 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:45 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:49:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Deleted volume successfully.
Jul 17 03:49:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-613ca87a-25be-4bd1-872a-6bea64153365 tempest-SnapshotDependencyTests-1861625650 None] Lock "cinder-e06bc9a1-70bd-462f-804b-6448ed87e96a-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Flow 'volume_create_manager' (8d46b257-c597-4256-8e49-d9d247238645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dbd6a6-47f6-4520-b3f6-881c403dbcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66dbd6a6-47f6-4520-b3f6-881c403dbcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-364088548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a0e551-56a7-4e31-a2ec-d71456531385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a98811ed21477b95cf73ad8c4f72f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:51Z,use_quota=True,user_id='2d40d61e933c471bbe6b32704e4cf0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb1beb0-c214-44d6-bc97-bc2e7d3183eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb1beb0-c214-44d6-bc97-bc2e7d3183eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9f5688-81ea-400d-8598-7b222cd1b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:50 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9f5688-81ea-400d-8598-7b222cd1b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9a0e551-56a7-4e31-a2ec-d71456531385', 'volume_name': 'volume-c9a0e551-56a7-4e31-a2ec-d71456531385', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf838f0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178a8977-fdc7-42af-94a4-f0f2338b960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178a8977-fdc7-42af-94a4-f0f2338b960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b112507f-122f-4c0e-98d4-2aa9d71a992d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Volume c9a0e551-56a7-4e31-a2ec-d71456531385: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9a0e551-56a7-4e31-a2ec-d71456531385', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf838f0>}
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Trying to clone c9a0e551-56a7-4e31-a2ec-d71456531385 from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 at location (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 03:49:52 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Image download 20.69 MB at 20.69 MB/s
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c766e-1dfd-43fd-be00-e8f7edf1d393]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:53 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD
Jul 17 03:49:53 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:53 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 is fetched for user 2d40d61e933c471bbe6b32704e4cf0ee. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbbb5f6-1b7d-486a-b560-656749bf1306]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:53 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD
Jul 17 03:49:53 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Flow 'volume_create_manager' (5e223672-10af-4913-bab9-6bb278de546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56796e32-2bc8-41a7-b192-e80a9d1406d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56796e32-2bc8-41a7-b192-e80a9d1406d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227d73ef-78c9-486b-bf57-b3cafb8822ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f44162081f4e3abc392b41ea632ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:54Z,use_quota=True,user_id='0aa74dfd75e94d4397332bbbbf158933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebc8aae-5053-4ce7-9fab-04e34cfae47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ebc8aae-5053-4ce7-9fab-04e34cfae47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f00b27e-bd82-488a-98f8-19a0486a7efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:53 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f00b27e-bd82-488a-98f8-19a0486a7efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227d73ef-78c9-486b-bf57-b3cafb8822ff', 'volume_name': 'volume-227d73ef-78c9-486b-bf57-b3cafb8822ff', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fd0df0-3bff-4bbe-b841-4710d5dc4d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2fd0df0-3bff-4bbe-b841-4710d5dc4d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b60b9a9-0da2-4bfb-9e9b-b6dd823b7b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Volume 227d73ef-78c9-486b-bf57-b3cafb8822ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227d73ef-78c9-486b-bf57-b3cafb8822ff', 'volume_size': 1}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227d73ef-78c9-486b-bf57-b3cafb8822ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f44162081f4e3abc392b41ea632ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:54Z,use_quota=True,user_id='0aa74dfd75e94d4397332bbbbf158933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Creating volume 227d73ef-78c9-486b-bf57-b3cafb8822ff {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:49:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:54 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff 1073741824
Jul 17 03:49:54 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:54 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff 1073741824" returned: 0 in 0.717s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:54 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff
Jul 17 03:49:54 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:55 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-364088548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a0e551-56a7-4e31-a2ec-d71456531385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a98811ed21477b95cf73ad8c4f72f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:51Z,use_quota=True,user_id='2d40d61e933c471bbe6b32704e4cf0ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Creating volume c9a0e551-56a7-4e31-a2ec-d71456531385 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:49:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:55 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 1073741824
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b60b9a9-0da2-4bfb-9e9b-b6dd823b7b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227d73ef-78c9-486b-bf57-b3cafb8822ff', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:55 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2333f215-274b-4aae-89a7-20222d479ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Volume volume-227d73ef-78c9-486b-bf57-b3cafb8822ff (227d73ef-78c9-486b-bf57-b3cafb8822ff): created successfully
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2333f215-274b-4aae-89a7-20222d479ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Flow 'volume_create_manager' (5e223672-10af-4913-bab9-6bb278de546b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e769ee57-e1db-487f-9650-ab468878173e tempest-CinderUnicodeTest-1210077258 None] Created volume successfully.
Jul 17 03:49:55 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 1073741824" returned: 0 in 0.662s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:55 devstack sudo[98662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385
Jul 17 03:49:55 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:56 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Attempting download of 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume c9a0e551-56a7-4e31-a2ec-d71456531385. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[280e7c5d-7eeb-47f6-b517-e072b40ad304]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_qje_hggu {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:56 devstack sudo[98667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_qje_hggu
Jul 17 03:49:56 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Flow 'volume_create_manager' (d30a8143-c982-456f-b7c1-9298df04c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b16390-8148-43a1-b70c-ed661225788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b16390-8148-43a1-b70c-ed661225788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-145490510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9541485e-1178-4bb4-92fb-faf8f4809a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f44162081f4e3abc392b41ea632ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:57Z,use_quota=True,user_id='0aa74dfd75e94d4397332bbbbf158933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd4e363-cae9-440b-9722-140e6d920370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd4e363-cae9-440b-9722-140e6d920370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:56 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36aecf7-0c34-4dc1-8066-8e0a9491f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36aecf7-0c34-4dc1-8066-8e0a9491f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9541485e-1178-4bb4-92fb-faf8f4809a2b', 'volume_name': 'volume-9541485e-1178-4bb4-92fb-faf8f4809a2b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65135da0-b2d3-4e08-8638-ecf0cf997122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65135da0-b2d3-4e08-8638-ecf0cf997122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271c8df4-5de6-4fd7-931b-5c65813e4000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Volume 9541485e-1178-4bb4-92fb-faf8f4809a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9541485e-1178-4bb4-92fb-faf8f4809a2b', 'volume_size': 1}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:49:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-145490510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9541485e-1178-4bb4-92fb-faf8f4809a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f44162081f4e3abc392b41ea632ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:49:57Z,use_quota=True,user_id='0aa74dfd75e94d4397332bbbbf158933',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Creating volume 9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:49:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_qje_hggu" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_qje_hggu {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:56 devstack sudo[98671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b 1073741824
Jul 17 03:49:56 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:57 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_qje_hggu
Jul 17 03:49:57 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:57 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_qje_hggu" returned: 1 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_qje_hggu' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c6dcef-42f5-4bf9-b902-4fb402baeda9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:57 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b 1073741824" returned: 0 in 0.493s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:57 devstack sudo[98682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b
Jul 17 03:49:57 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:57 devstack sudo[98681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD
Jul 17 03:49:57 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:57 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b" returned: 0 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271c8df4-5de6-4fd7-931b-5c65813e4000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9541485e-1178-4bb4-92fb-faf8f4809a2b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fcfdaf-c1dd-43d9-8ab9-09e11c7fe2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:49:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Volume volume-9541485e-1178-4bb4-92fb-faf8f4809a2b (9541485e-1178-4bb4-92fb-faf8f4809a2b): created successfully
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9fcfdaf-c1dd-43d9-8ab9-09e11c7fe2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Flow 'volume_create_manager' (d30a8143-c982-456f-b7c1-9298df04c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:49:57 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 03:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-768d08c2-b5e5-48b2-92b9-926845b3ee4a tempest-CinderUnicodeTest-1210077258 None] Created volume successfully.
Jul 17 03:49:57 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385
Jul 17 03:49:57 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Creating offline snapshot 60c271ab-a03f-4720-8c51-6d305afe76fc of volume 9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:49:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f47bf-8832-4bc4-b42a-d1082cafbc84]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:49:59 devstack sudo[98697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b
Jul 17 03:49:59 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:49:59 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root
Jul 17 03:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b" returned: 0 in 0.559s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:00 devstack sudo[98702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc 1G
Jul 17 03:50:00 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:00 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385" returned: 0 in 2.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_lm7hlq43devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:50:00 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Converted 112.00 MB image at 48.95 MB/s
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:00 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 1G
Jul 17 03:50:00 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:00 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc 1G" returned: 0 in 0.530s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9541485e-1178-4bb4-92fb-faf8f4809a2b -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:00 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9541485e-1178-4bb4-92fb-faf8f4809a2b -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc
Jul 17 03:50:00 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:00 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 1G" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Downloaded image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume c9a0e551-56a7-4e31-a2ec-d71456531385 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 for user 2d40d61e933c471bbe6b32704e4cf0ee is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Marking volume c9a0e551-56a7-4e31-a2ec-d71456531385 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=83,cinder:SELECT=74,cinder:INSERT=17,cinder:DELETE=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Copying metadata from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 to c9a0e551-56a7-4e31-a2ec-d71456531385. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Creating volume glance metadata for volume c9a0e551-56a7-4e31-a2ec-d71456531385 backed by image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=78,cinder:DELETE=5,cinder:INSERT=23,cinder:UPDATE=88 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b112507f-122f-4c0e-98d4-2aa9d71a992d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a0e551-56a7-4e31-a2ec-d71456531385', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf838f0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25e29e3-5d44-48a3-8a43-08910be37752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:50:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Volume volume-c9a0e551-56a7-4e31-a2ec-d71456531385 (c9a0e551-56a7-4e31-a2ec-d71456531385): created successfully
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25e29e3-5d44-48a3-8a43-08910be37752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Flow 'volume_create_manager' (8d46b257-c597-4256-8e49-d9d247238645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:50:00 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9541485e-1178-4bb4-92fb-faf8f4809a2b -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:00 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc is being set with open permissions: ugo+rw
Jul 17 03:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-61cbadfa-59c1-4c12-8a9d-e6ba96b9ae68 tempest-TestShelveInstance-204852453 None] Created volume successfully.
Jul 17 03:50:00 devstack sudo[98720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc
Jul 17 03:50:00 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:01 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:01 devstack sudo[98723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.info
Jul 17 03:50:01 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:01 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.info" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.info is being set with open permissions: ugo+rw
Jul 17 03:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:01 devstack sudo[98726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.info
Jul 17 03:50:01 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:01 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.info" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e0564618-28db-4cea-a3af-d722ac5a1bb2 tempest-CinderUnicodeTest-1210077258 None] Create snapshot completed successfully
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "cinder-60c271ab-a03f-4720-8c51-6d305afe76fc-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-60c271ab-a03f-4720-8c51-6d305afe76fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "cinder-quobyte-9541485e-1178-4bb4-92fb-faf8f4809a2b" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-9541485e-1178-4bb4-92fb-faf8f4809a2b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "cinder-quobyte-60c271ab-a03f-4720-8c51-6d305afe76fc" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-60c271ab-a03f-4720-8c51-6d305afe76fc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Deleting offline snapshot 60c271ab-a03f-4720-8c51-6d305afe76fc of volume 9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] snapshot_file for this snap is: volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71ddf89-270e-4da8-86b3-7f3ec6d90ab4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:50:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:02 devstack sudo[98730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc
Jul 17 03:50:02 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:03 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9541485e-1178-4bb4-92fb-faf8f4809a2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:50:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cac124f-8e52-4db7-973f-257d25f77fab]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:50:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:03 devstack sudo[98736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b
Jul 17 03:50:03 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:03 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:03 devstack sudo[98744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc
Jul 17 03:50:03 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:04 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc" returned: 0 in 0.449s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:04 devstack sudo[98771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc
Jul 17 03:50:04 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:04 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b.60c271ab-a03f-4720-8c51-6d305afe76fc" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-60c271ab-a03f-4720-8c51-6d305afe76fc" released by "_delete_snapshot" :: held 1.783s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-9541485e-1178-4bb4-92fb-faf8f4809a2b" released by "delete_snapshot" :: held 1.819s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Created reservations ['b229fe15-a063-4dc6-9c07-86406d4fece5', 'c0e6c616-ba25-455b-b923-dfa0f6c6110d', '5b67fde5-9279-4859-8fc7-c984dd7030eb', 'e8c5e350-4d4c-4670-8341-4acf1ecd9776'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:50:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Delete snapshot completed successfully.
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-11838259-8dae-4a78-b3b2-c20151784222 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-60c271ab-a03f-4720-8c51-6d305afe76fc-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "cinder-9541485e-1178-4bb4-92fb-faf8f4809a2b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-9541485e-1178-4bb4-92fb-faf8f4809a2b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "cinder-quobyte-9541485e-1178-4bb4-92fb-faf8f4809a2b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-9541485e-1178-4bb4-92fb-faf8f4809a2b" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4b36c8-287b-4670-942c-1eb204dbd117]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:50:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:04 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b
Jul 17 03:50:04 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-454f05a7-116b-4511-9f50-521e473b5ad7 req-2a2d0339-03f2-4117-a648-e031dfe718ad tempest-TestShelveInstance-204852453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-454f05a7-116b-4511-9f50-521e473b5ad7 req-2a2d0339-03f2-4117-a648-e031dfe718ad tempest-TestShelveInstance-204852453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-454f05a7-116b-4511-9f50-521e473b5ad7 req-2a2d0339-03f2-4117-a648-e031dfe718ad tempest-TestShelveInstance-204852453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-454f05a7-116b-4511-9f50-521e473b5ad7 req-2a2d0339-03f2-4117-a648-e031dfe718ad tempest-TestShelveInstance-204852453 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-c9a0e551-56a7-4e31-a2ec-d71456531385', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fcdf2f1-2e72-4f95-ad11-7eb9a164b3e9', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:50:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-454f05a7-116b-4511-9f50-521e473b5ad7 req-2a2d0339-03f2-4117-a648-e031dfe718ad tempest-TestShelveInstance-204852453 None] attachment_update completed successfully.
Jul 17 03:50:05 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:05 devstack sudo[98789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b
Jul 17 03:50:05 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:05 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9541485e-1178-4bb4-92fb-faf8f4809a2b" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-9541485e-1178-4bb4-92fb-faf8f4809a2b" released by "delete_volume" :: held 0.903s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Created reservations ['5e5ce54a-2097-4e55-8069-0bb3c4680b20', 'ac6100ab-c62e-4f9c-aab4-eb1cb617dd11', 'cc159a3d-75a9-4a02-a4d3-f5b53111eeae', 'f1a70f8b-0833-4e11-bbee-129d9dca05b1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:05 devstack sudo[98793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:50:05 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "cinder-227d73ef-78c9-486b-bf57-b3cafb8822ff-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:50:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-227d73ef-78c9-486b-bf57-b3cafb8822ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "cinder-quobyte-227d73ef-78c9-486b-bf57-b3cafb8822ff" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-227d73ef-78c9-486b-bf57-b3cafb8822ff" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fcf1cb-3c53-42b7-82d2-323ba9829b73]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:06 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:50:06 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff
Jul 17 03:50:06 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Deleted volume successfully.
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-63503f02-fa26-456a-ac16-2b2078be16e8 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-9541485e-1178-4bb4-92fb-faf8f4809a2b-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:50:06 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:06 devstack sudo[98801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff
Jul 17 03:50:06 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:06 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-227d73ef-78c9-486b-bf57-b3cafb8822ff" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-quobyte-227d73ef-78c9-486b-bf57-b3cafb8822ff" released by "delete_volume" :: held 0.712s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Created reservations ['1aa92d6e-00b8-4e10-91d5-e8f8d5bc0636', 'deaac116-ef55-48b2-a375-759f81ad4e15', '3333d5fc-2900-446e-bf7f-4e414af2a9af', 'b580f236-8784-4a7f-a6b6-e43384902c43'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:06 devstack sudo[98804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:50:06 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:07 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:50:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Deleted volume successfully.
Jul 17 03:50:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c2e3e30d-f9f7-4d31-b2c7-42bfc2930af1 tempest-CinderUnicodeTest-1210077258 None] Lock "cinder-227d73ef-78c9-486b-bf57-b3cafb8822ff-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:12 devstack sudo[98877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:50:12 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:12 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.679s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:50:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:50:16 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=21 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:50:17 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=35,cinder:INSERT=17,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:50:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-eed777f0-faf4-4507-a0fe-330d95155196 req-5e25596e-c288-4dce-a02d-ecf478e34d60 tempest-AttachVolumeNegativeTest-559320827 None] Terminate volume connection completed successfully.
Jul 17 03:50:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-eed777f0-faf4-4507-a0fe-330d95155196 req-5e25596e-c288-4dce-a02d-ecf478e34d60 tempest-AttachVolumeNegativeTest-559320827 None] Deleting attachment 16033963-844a-47c4-95a7-953b8d15e84f. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:50:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:50:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-02ae476d-967f-46f8-956f-7fd22f3c4fda req-7e403769-548e-4279-ae27-c15c2f3171d3 tempest-TestShelveInstance-204852453 None] Terminate volume connection completed successfully.
Jul 17 03:50:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-02ae476d-967f-46f8-956f-7fd22f3c4fda req-7e403769-548e-4279-ae27-c15c2f3171d3 tempest-TestShelveInstance-204852453 None] Deleting attachment 1fcdf2f1-2e72-4f95-ad11-7eb9a164b3e9. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd11046e-83fd-4dc8-9822-4673b727c977 req-4f646679-a688-4571-958e-aa05cb409d01 tempest-TestShelveInstance-204852453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd11046e-83fd-4dc8-9822-4673b727c977 req-4f646679-a688-4571-958e-aa05cb409d01 tempest-TestShelveInstance-204852453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-bd11046e-83fd-4dc8-9822-4673b727c977 req-4f646679-a688-4571-958e-aa05cb409d01 tempest-TestShelveInstance-204852453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bd11046e-83fd-4dc8-9822-4673b727c977 req-4f646679-a688-4571-958e-aa05cb409d01 tempest-TestShelveInstance-204852453 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-c9a0e551-56a7-4e31-a2ec-d71456531385', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84d281af-ec0b-457d-b9d5-d21b6b870626', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:50:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-bd11046e-83fd-4dc8-9822-4673b727c977 req-4f646679-a688-4571-958e-aa05cb409d01 tempest-TestShelveInstance-204852453 None] attachment_update completed successfully.
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Flow 'volume_create_manager' (e94deac8-0609-4738-8569-bf480a176700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eced3a6-1b9c-4c90-8c4d-8513c992d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eced3a6-1b9c-4c90-8c4d-8513c992d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1562073324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c14e3-e700-411f-8237-d1eaece9463f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2e8c1fc224bcfa31b6fc2d83a4cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:50:55Z,use_quota=True,user_id='558a46a330bd4cdcad020e32e3b57aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67af31f6-d0a5-4635-a62e-90f94b1d230b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67af31f6-d0a5-4635-a62e-90f94b1d230b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1017514e-1b85-4b37-af68-9e6bb57f8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:50:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1017514e-1b85-4b37-af68-9e6bb57f8d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4c14e3-e700-411f-8237-d1eaece9463f', 'volume_name': 'volume-4d4c14e3-e700-411f-8237-d1eaece9463f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2e7a27-9a5b-4668-8933-d472ca7c3b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2e7a27-9a5b-4668-8933-d472ca7c3b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5ad771-2dcb-40dc-bf54-2c2dfabe771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:50:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Volume 4d4c14e3-e700-411f-8237-d1eaece9463f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4c14e3-e700-411f-8237-d1eaece9463f', 'volume_size': 1}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1562073324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4c14e3-e700-411f-8237-d1eaece9463f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2e8c1fc224bcfa31b6fc2d83a4cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:50:55Z,use_quota=True,user_id='558a46a330bd4cdcad020e32e3b57aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Creating volume 4d4c14e3-e700-411f-8237-d1eaece9463f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:50:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:55 devstack sudo[99169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f 1073741824
Jul 17 03:50:55 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:55 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f 1073741824" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:50:55 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f
Jul 17 03:50:55 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:50:55 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5ad771-2dcb-40dc-bf54-2c2dfabe771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4c14e3-e700-411f-8237-d1eaece9463f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb3a7bc-8725-496e-9fe1-a20f4983b815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:50:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Volume volume-4d4c14e3-e700-411f-8237-d1eaece9463f (4d4c14e3-e700-411f-8237-d1eaece9463f): created successfully
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb3a7bc-8725-496e-9fe1-a20f4983b815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:50:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Flow 'volume_create_manager' (e94deac8-0609-4738-8569-bf480a176700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:50:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-33312a09-cd5b-4d5a-a047-bd73f66897cc tempest-AttachVolumeNegativeTest-559320827 None] Created volume successfully.
Jul 17 03:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a85894cd-9306-4f3d-a313-35c8ba6fba7a req-0ed02485-9112-4c64-8735-1f21e48a4063 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a85894cd-9306-4f3d-a313-35c8ba6fba7a req-0ed02485-9112-4c64-8735-1f21e48a4063 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a85894cd-9306-4f3d-a313-35c8ba6fba7a req-0ed02485-9112-4c64-8735-1f21e48a4063 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-a85894cd-9306-4f3d-a313-35c8ba6fba7a req-0ed02485-9112-4c64-8735-1f21e48a4063 tempest-AttachVolumeNegativeTest-559320827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-4d4c14e3-e700-411f-8237-d1eaece9463f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89b3ebf2-3235-4ead-9079-9df4097867ac', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:50:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-a85894cd-9306-4f3d-a313-35c8ba6fba7a req-0ed02485-9112-4c64-8735-1f21e48a4063 tempest-AttachVolumeNegativeTest-559320827 None] attachment_update completed successfully.
Jul 17 03:51:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-3f456f20-6637-4dfb-9183-caff7d52439c req-e0b52a97-50ea-428a-83a7-728d2baf0a38 tempest-AttachVolumeNegativeTest-559320827 None] Terminate volume connection completed successfully.
Jul 17 03:51:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-3f456f20-6637-4dfb-9183-caff7d52439c req-e0b52a97-50ea-428a-83a7-728d2baf0a38 tempest-AttachVolumeNegativeTest-559320827 None] Deleting attachment 89b3ebf2-3235-4ead-9079-9df4097867ac. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:51:10 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=19,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:51:10 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:12 devstack sudo[99760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:51:12 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:12 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:51:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Flow 'volume_create_manager' (bd32cc0b-d3a8-4285-ba80-c2136ed90227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633be75b-0d8d-4e8c-a2cc-a7ac9395a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633be75b-0d8d-4e8c-a2cc-a7ac9395a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722911014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477fca71-820a-4e07-97da-579a8a89ebd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2e8c1fc224bcfa31b6fc2d83a4cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:51:36Z,use_quota=True,user_id='558a46a330bd4cdcad020e32e3b57aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593e4767-e82b-4b35-ac40-cbdcb162ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593e4767-e82b-4b35-ac40-cbdcb162ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0ed0d1-628f-440b-a205-fada5b029972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0ed0d1-628f-440b-a205-fada5b029972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477fca71-820a-4e07-97da-579a8a89ebd6', 'volume_name': 'volume-477fca71-820a-4e07-97da-579a8a89ebd6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec3bf16-ee58-4b93-844f-699b31ae6466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec3bf16-ee58-4b93-844f-699b31ae6466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112bc73a-d63a-4e13-9936-753353b95d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Volume 477fca71-820a-4e07-97da-579a8a89ebd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477fca71-820a-4e07-97da-579a8a89ebd6', 'volume_size': 1}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-722911014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477fca71-820a-4e07-97da-579a8a89ebd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e2e8c1fc224bcfa31b6fc2d83a4cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:51:36Z,use_quota=True,user_id='558a46a330bd4cdcad020e32e3b57aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Creating volume 477fca71-820a-4e07-97da-579a8a89ebd6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:51:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:35 devstack sudo[99831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6 1073741824
Jul 17 03:51:35 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:36 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6 1073741824" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:36 devstack sudo[99874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6
Jul 17 03:51:36 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:36 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112bc73a-d63a-4e13-9936-753353b95d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477fca71-820a-4e07-97da-579a8a89ebd6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca6f7f-d696-4fed-8243-d37f37db863f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Volume volume-477fca71-820a-4e07-97da-579a8a89ebd6 (477fca71-820a-4e07-97da-579a8a89ebd6): created successfully
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ca6f7f-d696-4fed-8243-d37f37db863f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Flow 'volume_create_manager' (bd32cc0b-d3a8-4285-ba80-c2136ed90227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:51:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fa822f6e-cfed-46b9-b74f-e75d06e6b297 tempest-AttachVolumeNegativeTest-559320827 None] Created volume successfully.
Jul 17 03:51:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-99922d56-f449-4f35-8628-7171ae5916cc req-3960023c-47dd-4e67-9132-114404c2fbd0 tempest-TestShelveInstance-204852453 None] Terminate volume connection completed successfully.
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-99922d56-f449-4f35-8628-7171ae5916cc req-3960023c-47dd-4e67-9132-114404c2fbd0 tempest-TestShelveInstance-204852453 None] Deleting attachment 84d281af-ec0b-457d-b9d5-d21b6b870626. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Acquiring lock "cinder-c9a0e551-56a7-4e31-a2ec-d71456531385-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Lock "cinder-c9a0e551-56a7-4e31-a2ec-d71456531385-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Acquiring lock "cinder-quobyte-c9a0e551-56a7-4e31-a2ec-d71456531385" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Lock "cinder-quobyte-c9a0e551-56a7-4e31-a2ec-d71456531385" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e0699b-9315-4166-9691-9a07395e4134]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:38 devstack sudo[99913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385
Jul 17 03:51:38 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-f21bcdb6-34ac-4202-bc4c-4a1f514c3dcf req-b8eccd8b-6a7b-482c-9c18-183402bac779 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-f21bcdb6-34ac-4202-bc4c-4a1f514c3dcf req-b8eccd8b-6a7b-482c-9c18-183402bac779 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-f21bcdb6-34ac-4202-bc4c-4a1f514c3dcf req-b8eccd8b-6a7b-482c-9c18-183402bac779 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-f21bcdb6-34ac-4202-bc4c-4a1f514c3dcf req-b8eccd8b-6a7b-482c-9c18-183402bac779 tempest-AttachVolumeNegativeTest-559320827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-477fca71-820a-4e07-97da-579a8a89ebd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd234e172-88ad-448b-a7ea-559c73ff1a8c', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:51:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-f21bcdb6-34ac-4202-bc4c-4a1f514c3dcf req-b8eccd8b-6a7b-482c-9c18-183402bac779 tempest-AttachVolumeNegativeTest-559320827 None] attachment_update completed successfully.
Jul 17 03:51:39 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:39 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385
Jul 17 03:51:39 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:39 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c9a0e551-56a7-4e31-a2ec-d71456531385" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Lock "cinder-quobyte-c9a0e551-56a7-4e31-a2ec-d71456531385" released by "delete_volume" :: held 0.775s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG cinder.quota [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Created reservations ['2d68b688-6413-4064-8188-1498f6688278', 'f883edd8-7588-4637-8064-6cc2ef63e719', '78d5845e-7902-45e6-b398-986f78969278', '43981f56-c8da-45a7-9ca5-3c0a31af03a5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:39 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:51:39 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:39 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:40 devstack cinder-volume[87498]: DEBUG cinder.manager [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:51:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Deleted volume successfully.
Jul 17 03:51:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-99922d56-f449-4f35-8628-7171ae5916cc req-07fb6647-acfa-46b2-92f3-af0359caeead tempest-TestShelveInstance-204852453 None] Lock "cinder-c9a0e551-56a7-4e31-a2ec-d71456531385-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-25673d58-0cc8-470f-ac4b-b08e64a615a9 req-645a2bdc-f8e2-4885-8060-f98907557282 tempest-AttachVolumeNegativeTest-559320827 None] Terminate volume connection completed successfully.
Jul 17 03:51:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-25673d58-0cc8-470f-ac4b-b08e64a615a9 req-645a2bdc-f8e2-4885-8060-f98907557282 tempest-AttachVolumeNegativeTest-559320827 None] Deleting attachment d234e172-88ad-448b-a7ea-559c73ff1a8c. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:51:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "cinder-477fca71-820a-4e07-97da-579a8a89ebd6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-477fca71-820a-4e07-97da-579a8a89ebd6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "cinder-quobyte-477fca71-820a-4e07-97da-579a8a89ebd6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-quobyte-477fca71-820a-4e07-97da-579a8a89ebd6" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dcd3f5-a303-4d5d-a422-3271e6362629]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:47 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6
Jul 17 03:51:47 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:47 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:47 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6
Jul 17 03:51:47 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:47 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-477fca71-820a-4e07-97da-579a8a89ebd6" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-quobyte-477fca71-820a-4e07-97da-579a8a89ebd6" released by "delete_volume" :: held 0.741s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Created reservations ['9e6ad5d9-d92f-43e2-8252-86d30c3cd040', '4fbf0c32-b209-4fe6-bd53-65245d41f46d', 'ec0cd2c5-d374-4098-b837-543b48a4b7e1', 'a2847862-e620-4b57-9d5d-39b061b17c95'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:47 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:51:47 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:48 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:51:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Deleted volume successfully.
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-28607313-0a40-4f61-9d1e-52751a7fc459 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-477fca71-820a-4e07-97da-579a8a89ebd6-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "cinder-4d4c14e3-e700-411f-8237-d1eaece9463f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-4d4c14e3-e700-411f-8237-d1eaece9463f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "cinder-quobyte-4d4c14e3-e700-411f-8237-d1eaece9463f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-quobyte-4d4c14e3-e700-411f-8237-d1eaece9463f" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e034e8f-8c79-4b8f-b372-6339bf025ec0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:48 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f
Jul 17 03:51:48 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:48 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:48 devstack sudo[100382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f
Jul 17 03:51:48 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:49 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d4c14e3-e700-411f-8237-d1eaece9463f" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-quobyte-4d4c14e3-e700-411f-8237-d1eaece9463f" released by "delete_volume" :: held 0.717s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Created reservations ['18c9cdb0-ddb0-4c90-b8a9-e509ecd4d2f7', 'ba3540de-de2b-45b3-bb55-9539a492f677', 'aef28962-35ce-4229-9933-743cefef606c', 'c3c7c0ec-9bac-4a57-be17-6dae5c4a49e6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:49 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:51:49 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:49 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:51:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Deleted volume successfully.
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2bec79b7-0ff1-465e-ae2d-d71d90c8539f tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-4d4c14e3-e700-411f-8237-d1eaece9463f-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "cinder-7ccb6c50-647a-4262-92ea-d735637e11e4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-7ccb6c50-647a-4262-92ea-d735637e11e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "cinder-quobyte-7ccb6c50-647a-4262-92ea-d735637e11e4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-quobyte-7ccb6c50-647a-4262-92ea-d735637e11e4" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7808c204-2bbb-4231-94c7-8269a13a4864]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:51:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:49 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4
Jul 17 03:51:49 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:50 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:50 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4
Jul 17 03:51:50 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:50 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7ccb6c50-647a-4262-92ea-d735637e11e4" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-quobyte-7ccb6c50-647a-4262-92ea-d735637e11e4" released by "delete_volume" :: held 0.708s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Created reservations ['9bf63cdf-aed3-427f-b437-24a3b4d27a61', 'e5eabe4e-84db-4107-912a-b526f777aba9', 'a3528865-9755-4457-bb72-5c70bf8a92f7', '81182c1a-cbbc-42cf-a3d9-bcb8639a2c2e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:50 devstack sudo[100396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:51:50 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:50 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:51:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Deleted volume successfully.
Jul 17 03:51:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5f8694ad-c7e7-4451-a8c4-2c9beb252908 tempest-AttachVolumeNegativeTest-559320827 None] Lock "cinder-7ccb6c50-647a-4262-92ea-d735637e11e4-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Flow 'volume_create_manager' (fefa82be-d8a6-41d4-91b2-82e7cc52135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec07ebcf-6616-49ee-a6e2-5746a25510bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec07ebcf-6616-49ee-a6e2-5746a25510bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1182804873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c334a20-5c4f-40bf-a09f-2252826de80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed840404585c4563a7322af99d15a8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:51:52Z,use_quota=True,user_id='ac38e67abc704a33bf70d52ceea5527f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710828d4-a16d-4847-939c-7b8032f25c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710828d4-a16d-4847-939c-7b8032f25c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704cd6d6-f15f-4feb-b3a0-24e8bb711227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704cd6d6-f15f-4feb-b3a0-24e8bb711227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c334a20-5c4f-40bf-a09f-2252826de80d', 'volume_name': 'volume-0c334a20-5c4f-40bf-a09f-2252826de80d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855678e2-9e5e-4509-85de-74a916da37e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855678e2-9e5e-4509-85de-74a916da37e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b797c7-be10-4513-800d-755187a3d2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Volume 0c334a20-5c4f-40bf-a09f-2252826de80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c334a20-5c4f-40bf-a09f-2252826de80d', 'volume_size': 1}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1182804873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c334a20-5c4f-40bf-a09f-2252826de80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed840404585c4563a7322af99d15a8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:51:52Z,use_quota=True,user_id='ac38e67abc704a33bf70d52ceea5527f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Creating volume 0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:51:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:51:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:51 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d 1073741824
Jul 17 03:51:51 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:52 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d 1073741824" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:52 devstack sudo[100405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d
Jul 17 03:51:52 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:52 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b797c7-be10-4513-800d-755187a3d2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c334a20-5c4f-40bf-a09f-2252826de80d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865cd539-e337-4cb1-b5bb-8f44186f5851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Volume volume-0c334a20-5c4f-40bf-a09f-2252826de80d (0c334a20-5c4f-40bf-a09f-2252826de80d): created successfully
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865cd539-e337-4cb1-b5bb-8f44186f5851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Flow 'volume_create_manager' (fefa82be-d8a6-41d4-91b2-82e7cc52135b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:51:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-873a36f5-cc02-490d-8563-f906f081418c tempest-VolumeDependencyTests-851314803 None] Created volume successfully.
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Creating offline snapshot efdeb849-2a99-45c9-a2c8-e98a0620e5ee of volume 0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f27a15c-0ebb-4cf7-80a0-d5a8d9347aea]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:51:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:53 devstack sudo[100408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d
Jul 17 03:51:53 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:53 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:53 devstack sudo[100414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee 1G
Jul 17 03:51:53 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:53 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee 1G" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c334a20-5c4f-40bf-a09f-2252826de80d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:53 devstack sudo[100420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c334a20-5c4f-40bf-a09f-2252826de80d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee
Jul 17 03:51:53 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:54 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c334a20-5c4f-40bf-a09f-2252826de80d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee is being set with open permissions: ugo+rw
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:54 devstack sudo[100425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee
Jul 17 03:51:54 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:54 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:54 devstack sudo[100429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.info
Jul 17 03:51:54 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:54 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.info" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.info is being set with open permissions: ugo+rw
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:54 devstack sudo[100432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.info
Jul 17 03:51:54 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:54 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.info" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-03bc1dea-b26c-4661-b463-d9a29a3408a6 tempest-VolumeDependencyTests-851314803 None] Create snapshot completed successfully
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Flow 'volume_create_manager' (23b74d95-0ad6-49f1-b6e9-d4244c5e4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d9bb98-5172-4397-8cc6-431771bd512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d9bb98-5172-4397-8cc6-431771bd512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-510345100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55c4aac-4533-4e81-a080-ab9594baa141,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed840404585c4563a7322af99d15a8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=efdeb849-2a99-45c9-a2c8-e98a0620e5ee,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:51:57Z,use_quota=True,user_id='ac38e67abc704a33bf70d52ceea5527f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d2f04a-ddf9-4de9-9f74-3e278ee75f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24d2f04a-ddf9-4de9-9f74-3e278ee75f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7c565d-f57e-492c-988c-d89475bf6d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7c565d-f57e-492c-988c-d89475bf6d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f55c4aac-4533-4e81-a080-ab9594baa141', 'volume_name': 'volume-f55c4aac-4533-4e81-a080-ab9594baa141', 'volume_size': 1, 'snapshot_id': 'efdeb849-2a99-45c9-a2c8-e98a0620e5ee'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11ce559-8404-4a00-a1c9-eb9bda4b9a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c11ce559-8404-4a00-a1c9-eb9bda4b9a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedaeff5-73c3-4773-89b4-e405addfc511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:51:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Volume f55c4aac-4533-4e81-a080-ab9594baa141: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f55c4aac-4533-4e81-a080-ab9594baa141', 'volume_size': 1, 'snapshot_id': 'efdeb849-2a99-45c9-a2c8-e98a0620e5ee'}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-quobyte-efdeb849-2a99-45c9-a2c8-e98a0620e5ee-f55c4aac-4533-4e81-a080-ab9594baa141" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-efdeb849-2a99-45c9-a2c8-e98a0620e5ee-f55c4aac-4533-4e81-a080-ab9594baa141" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Creating volume f55c4aac-4533-4e81-a080-ab9594baa141 from snapshot efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-quobyte-f55c4aac-4533-4e81-a080-ab9594baa141" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-f55c4aac-4533-4e81-a080-ab9594baa141" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] snapshot: efdeb849-2a99-45c9-a2c8-e98a0620e5ee, volume: f55c4aac-4533-4e81-a080-ab9594baa141,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d289ef-4fd3-452f-958c-136210635f91]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:51:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:56 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee
Jul 17 03:51:56 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:57 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c334a20-5c4f-40bf-a09f-2252826de80d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fe3e0b-4a7d-43e8-9300-96b4f243d7dd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:57 devstack sudo[100441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d
Jul 17 03:51:57 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:51:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-30a4f1b9-2798-4466-b319-419ae6044cb9 tempest-GroupSnapshotsV319Test-538929068 None] Group tempest-GroupSnapshotsV319Test-Group-1329907191: creating
Jul 17 03:51:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-30a4f1b9-2798-4466-b319-419ae6044cb9 tempest-GroupSnapshotsV319Test-538929068 None] Group tempest-GroupSnapshotsV319Test-Group-1329907191: created successfully
Jul 17 03:51:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-30a4f1b9-2798-4466-b319-419ae6044cb9 tempest-GroupSnapshotsV319Test-538929068 None] Create group completed successfully.
Jul 17 03:51:57 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:51:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:51:57 devstack sudo[100446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141
Jul 17 03:51:57 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Flow 'volume_create_manager' (1c488db3-a78a-4d4b-88cd-67b84d4e524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398e3749-415b-4f19-92e2-a5bef20919ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398e3749-415b-4f19-92e2-a5bef20919ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719074989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78567c6c-d316-46e6-945f-788af9af78f8,host='devstack@QuobyteHD#QuobyteHD',id=085e7207-5d96-4dec-b20d-b647eca9399b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb3b7b91a4ad2aff5355304a935b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:00Z,use_quota=True,user_id='a92542f6fd1c4f92bddf7b03b4b8ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b1127fe-0f4d-4b11-85b1-31c188aba109),volume_type_id=0b1127fe-0f4d-4b11-85b1-31c188aba109)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d961761-a72c-44c1-93c3-593a6224a941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d961761-a72c-44c1-93c3-593a6224a941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7059651b-672c-4d11-b851-f23f940a4dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7059651b-672c-4d11-b851-f23f940a4dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085e7207-5d96-4dec-b20d-b647eca9399b', 'volume_name': 'volume-085e7207-5d96-4dec-b20d-b647eca9399b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948046d4-c205-41d6-b679-46861922c90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948046d4-c205-41d6-b679-46861922c90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c378ac9-eda6-4be3-9674-ce272988bf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Volume 085e7207-5d96-4dec-b20d-b647eca9399b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085e7207-5d96-4dec-b20d-b647eca9399b', 'volume_size': 1}
Jul 17 03:52:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:01 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141" returned: 0 in 4.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3960f58b-bc6a-4766-a69f-7230bedcd7bd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:02 devstack sudo[100459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d
Jul 17 03:52:02 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:02 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d, size 1024.00 MB, duration 4.45 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:52:02 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Converted 1024.00 MB image at 230.29 MB/s
Jul 17 03:52:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141 is being set with open permissions: ugo+rw
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:02 devstack sudo[100465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141
Jul 17 03:52:02 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:02 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-f55c4aac-4533-4e81-a080-ab9594baa141" released by "_copy_volume_from_snapshot" :: held 6.046s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-efdeb849-2a99-45c9-a2c8-e98a0620e5ee-f55c4aac-4533-4e81-a080-ab9594baa141" released by "_create_volume_from_snapshot" :: held 6.080s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.096s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.566s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78567c6c-d316-46e6-945f-788af9af78f8,created_at=2026-07-17T01:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1719074989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78567c6c-d316-46e6-945f-788af9af78f8,host='devstack@QuobyteHD#QuobyteHD',id=085e7207-5d96-4dec-b20d-b647eca9399b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76cb3b7b91a4ad2aff5355304a935b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:00Z,use_quota=True,user_id='a92542f6fd1c4f92bddf7b03b4b8ca5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b1127fe-0f4d-4b11-85b1-31c188aba109),volume_type_id=0b1127fe-0f4d-4b11-85b1-31c188aba109)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Creating volume 085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:02 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:02 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b 1073741824
Jul 17 03:52:02 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dedaeff5-73c3-4773-89b4-e405addfc511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55c4aac-4533-4e81-a080-ab9594baa141', 'volume_size': 1, 'snapshot_id': 'efdeb849-2a99-45c9-a2c8-e98a0620e5ee'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7845bbaa-4c09-4c95-a089-6a03bdac29ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Volume volume-f55c4aac-4533-4e81-a080-ab9594baa141 (f55c4aac-4533-4e81-a080-ab9594baa141): created successfully
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7845bbaa-4c09-4c95-a089-6a03bdac29ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Flow 'volume_create_manager' (23b74d95-0ad6-49f1-b6e9-d4244c5e4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-baeac334-4941-4c88-9229-1a9af76eed59 tempest-VolumeDependencyTests-851314803 None] Created volume successfully.
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-efdeb849-2a99-45c9-a2c8-e98a0620e5ee-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-efdeb849-2a99-45c9-a2c8-e98a0620e5ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-quobyte-0c334a20-5c4f-40bf-a09f-2252826de80d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-0c334a20-5c4f-40bf-a09f-2252826de80d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-quobyte-efdeb849-2a99-45c9-a2c8-e98a0620e5ee" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-efdeb849-2a99-45c9-a2c8-e98a0620e5ee" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Deleting offline snapshot efdeb849-2a99-45c9-a2c8-e98a0620e5ee of volume 0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] snapshot_file for this snap is: volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c842d-c1dc-4227-bba2-d5edc4454afc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:03 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b 1073741824" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:03 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee
Jul 17 03:52:03 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:03 devstack sudo[100475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b
Jul 17 03:52:03 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:03 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:03 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c378ac9-eda6-4be3-9674-ce272988bf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085e7207-5d96-4dec-b20d-b647eca9399b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a890ff02-db5b-4dce-ac51-8654dcc3367e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c334a20-5c4f-40bf-a09f-2252826de80d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:52:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Volume volume-085e7207-5d96-4dec-b20d-b647eca9399b (085e7207-5d96-4dec-b20d-b647eca9399b): created successfully
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a890ff02-db5b-4dce-ac51-8654dcc3367e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Flow 'volume_create_manager' (1c488db3-a78a-4d4b-88cd-67b84d4e524f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02d509a-9f1d-4f8b-9d98-739133921b9c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-69c18c12-18c0-40f8-b0e8-8aaa347e7659 tempest-GroupSnapshotsV319Test-538929068 None] Created volume successfully.
Jul 17 03:52:03 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d
Jul 17 03:52:03 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:03 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:03 devstack sudo[100487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee
Jul 17 03:52:03 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] GroupSnapshot e002b48b-5a49-47ff-abe7-abe490f1d9d3: creating.
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Group snapshot e002b48b-5a49-47ff-abe7-abe490f1d9d3: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Creating offline snapshot d78021e1-07fe-453d-809f-2a5dd81b9c71 of volume 085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[00151ce4-59aa-4087-afd8-846d2ad61432]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:04 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b
Jul 17 03:52:04 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:04 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:04 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee
Jul 17 03:52:04 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:04 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:04 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 1G
Jul 17 03:52:04 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:04 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d.efdeb849-2a99-45c9-a2c8-e98a0620e5ee" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-efdeb849-2a99-45c9-a2c8-e98a0620e5ee" released by "_delete_snapshot" :: held 1.464s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-0c334a20-5c4f-40bf-a09f-2252826de80d" released by "delete_snapshot" :: held 1.485s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Created reservations ['92fab6a7-bbe1-43e7-836f-559ba47d9dba', '456efef1-3e8f-4b17-9b62-d13cce4ae9ef', 'd74de466-51c8-4af3-abf7-696c16e22f5b', '5e74880d-17f9-4f03-99b3-cf435e660f76'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Delete snapshot completed successfully.
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d853455-8563-4f94-9aa1-fa94056e6a12 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-efdeb849-2a99-45c9-a2c8-e98a0620e5ee-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:04 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 1G" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085e7207-5d96-4dec-b20d-b647eca9399b -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:04 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085e7207-5d96-4dec-b20d-b647eca9399b -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71
Jul 17 03:52:04 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:05 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-085e7207-5d96-4dec-b20d-b647eca9399b -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-0c334a20-5c4f-40bf-a09f-2252826de80d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:05 devstack sudo[100513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71
Jul 17 03:52:05 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-0c334a20-5c4f-40bf-a09f-2252826de80d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-quobyte-0c334a20-5c4f-40bf-a09f-2252826de80d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-0c334a20-5c4f-40bf-a09f-2252826de80d" acquired by "delete_volume" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a3495-8116-484c-bbcb-7ff760b6b9b1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:05 devstack sudo[100515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d
Jul 17 03:52:05 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:05 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:05 devstack sudo[100518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.info
Jul 17 03:52:05 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:05 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:05 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d
Jul 17 03:52:05 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:05 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.info" returned: 0 in 0.257s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:05 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.info
Jul 17 03:52:05 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:05 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0c334a20-5c4f-40bf-a09f-2252826de80d" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-0c334a20-5c4f-40bf-a09f-2252826de80d" released by "delete_volume" :: held 0.662s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:06 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.info" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Created reservations ['7455c85e-d903-4896-9f28-b5b44170e7c7', '97d72b2d-ce40-4e75-b425-67bb000b93f1', '30c42c56-2645-4bcb-b790-958added4d6f', 'baccfb71-4837-490a-a3f1-ea4be15b1d5c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b5a37d3f-ffe2-4b80-86b8-5c857b89ce4d tempest-GroupSnapshotsV319Test-538929068 None] group_snapshot e002b48b-5a49-47ff-abe7-abe490f1d9d3: created successfully
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:06 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:06 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:06 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Deleted volume successfully.
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6ec7feda-4701-4657-96e1-529c860d15c0 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-0c334a20-5c4f-40bf-a09f-2252826de80d-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-f55c4aac-4533-4e81-a080-ab9594baa141-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-f55c4aac-4533-4e81-a080-ab9594baa141-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "cinder-quobyte-f55c4aac-4533-4e81-a080-ab9594baa141" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-f55c4aac-4533-4e81-a080-ab9594baa141" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ce82a-4a74-4aea-ac35-3fbe78984c0e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] group_snapshot e002b48b-5a49-47ff-abe7-abe490f1d9d3: deleting
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] group_snapshot e002b48b-5a49-47ff-abe7-abe490f1d9d3: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Acquiring lock "cinder-quobyte-085e7207-5d96-4dec-b20d-b647eca9399b" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Lock "cinder-quobyte-085e7207-5d96-4dec-b20d-b647eca9399b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Acquiring lock "cinder-quobyte-d78021e1-07fe-453d-809f-2a5dd81b9c71" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Lock "cinder-quobyte-d78021e1-07fe-453d-809f-2a5dd81b9c71" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Deleting offline snapshot d78021e1-07fe-453d-809f-2a5dd81b9c71 of volume 085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:52:06 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141
Jul 17 03:52:06 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] snapshot_file for this snap is: volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf01cf9-e766-4b79-919c-aeb110b3b9c6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:06 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71
Jul 17 03:52:06 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:06 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:06 devstack sudo[100541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141
Jul 17 03:52:06 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:07 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-085e7207-5d96-4dec-b20d-b647eca9399b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd750d-2126-49bd-8af0-7b6a74cdc361]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:07 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f55c4aac-4533-4e81-a080-ab9594baa141" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-quobyte-f55c4aac-4533-4e81-a080-ab9594baa141" released by "delete_volume" :: held 0.680s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:07 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b
Jul 17 03:52:07 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Created reservations ['b4854d0d-def4-453f-9785-5b1e8c3a4505', '992053e9-ea3e-45f4-8684-6b8cef41603b', '70492080-095f-4c6a-86de-b2b8f8833e97', 'ba8c5a8f-7c02-4b7c-be03-30feef1f638a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:07 devstack sudo[100549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:07 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:07 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:07 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71
Jul 17 03:52:07 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:07 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Deleted volume successfully.
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c0d568a6-732a-42fa-9da9-1032ecd10c44 tempest-VolumeDependencyTests-851314803 None] Lock "cinder-f55c4aac-4533-4e81-a080-ab9594baa141-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:07 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:07 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71
Jul 17 03:52:07 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:08 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b.d78021e1-07fe-453d-809f-2a5dd81b9c71" returned: 0 in 0.257s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Lock "cinder-quobyte-d78021e1-07fe-453d-809f-2a5dd81b9c71" released by "_delete_snapshot" :: held 1.436s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Lock "cinder-quobyte-085e7207-5d96-4dec-b20d-b647eca9399b" released by "delete_snapshot" :: held 1.455s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:08 devstack cinder-volume[87498]: WARNING cinder.quota [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-206045984 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-206045984, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:52:08 devstack cinder-volume[87498]: WARNING cinder.quota [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-206045984 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-206045984, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:52:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] Created reservations ['60d608e7-e3f9-45f7-960b-386405df17f2', '741e0665-1a6f-4b56-9bc9-d6398aef64c6', '064b8a23-9269-4f0b-80e2-47a1ff8aabe6', 'ac15fe68-15c9-4646-b3c3-b4c7a813c5bc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-03c40d10-64a4-42af-8911-01daa2c0db05 tempest-GroupSnapshotsV319Test-538929068 None] group_snapshot e002b48b-5a49-47ff-abe7-abe490f1d9d3: deleted successfully
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Acquiring lock "cinder-quobyte-085e7207-5d96-4dec-b20d-b647eca9399b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Lock "cinder-quobyte-085e7207-5d96-4dec-b20d-b647eca9399b" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec520afa-9dff-48f2-ac6f-70548aff230c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:09 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b
Jul 17 03:52:09 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:09 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:09 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b
Jul 17 03:52:09 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:09 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-085e7207-5d96-4dec-b20d-b647eca9399b" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Lock "cinder-quobyte-085e7207-5d96-4dec-b20d-b647eca9399b" released by "delete_volume" :: held 0.695s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Created reservations ['616edcf6-c99a-4d99-abed-2972ae4bcaf0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:09 devstack cinder-volume[87498]: WARNING cinder.quota [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-206045984 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-206045984, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:52:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Created reservations ['3318aa51-c0c5-4a6d-9784-b72d0b2d3990', 'b8785726-9330-464f-8b04-4c6e0b21158a', 'a4f0d903-3919-4e8c-a4d6-d415bbdf57a2', '3ef6c38a-fadf-48c7-997e-c88db102b455'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:10 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:10 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:10 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1769145d-f64a-41b2-99ac-4b518c0a77ac tempest-GroupSnapshotsV319Test-538929068 None] Delete group completed successfully.
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Flow 'volume_create_manager' (260fcf1c-1071-4be4-a6c0-7d83088a197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7d882c-c8bd-46e5-89ce-a9a3e6da7e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7d882c-c8bd-46e5-89ce-a9a3e6da7e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-147034633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13574450-2650-4468-b7f5-83bdbfd1341a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20539ace8149229df3a5252cf19ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:11Z,use_quota=True,user_id='95172bf000a34980b7ed72630b9a022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03427f99-2588-408c-9c6f-071d36400763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03427f99-2588-408c-9c6f-071d36400763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475c838d-79a7-4531-bfb6-4f64253edca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475c838d-79a7-4531-bfb6-4f64253edca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13574450-2650-4468-b7f5-83bdbfd1341a', 'volume_name': 'volume-13574450-2650-4468-b7f5-83bdbfd1341a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518f90e1-6168-4e13-a5ba-dc868481320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (518f90e1-6168-4e13-a5ba-dc868481320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06034f9f-6210-4fab-9848-9c74850b78b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Volume 13574450-2650-4468-b7f5-83bdbfd1341a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13574450-2650-4468-b7f5-83bdbfd1341a', 'volume_size': 1}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-147034633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13574450-2650-4468-b7f5-83bdbfd1341a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20539ace8149229df3a5252cf19ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:11Z,use_quota=True,user_id='95172bf000a34980b7ed72630b9a022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Creating volume 13574450-2650-4468-b7f5-83bdbfd1341a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:11 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:11 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a 1073741824
Jul 17 03:52:11 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:11 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a 1073741824" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:11 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a
Jul 17 03:52:11 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:12 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06034f9f-6210-4fab-9848-9c74850b78b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13574450-2650-4468-b7f5-83bdbfd1341a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5196c9-bfde-4e78-b296-7027e0032bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Volume volume-13574450-2650-4468-b7f5-83bdbfd1341a (13574450-2650-4468-b7f5-83bdbfd1341a): created successfully
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5196c9-bfde-4e78-b296-7027e0032bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Flow 'volume_create_manager' (260fcf1c-1071-4be4-a6c0-7d83088a197d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-43e9724e-8bac-47c9-8543-fddefa84334a tempest-ProjectReaderTests-308198121 None] Created volume successfully.
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:12 devstack sudo[100584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:12 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Acquiring lock "cinder-13574450-2650-4468-b7f5-83bdbfd1341a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Lock "cinder-13574450-2650-4468-b7f5-83bdbfd1341a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:12 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Acquiring lock "cinder-quobyte-13574450-2650-4468-b7f5-83bdbfd1341a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Lock "cinder-quobyte-13574450-2650-4468-b7f5-83bdbfd1341a" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2c28a4-dabb-4670-8f5c-8221ece6c310]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:12 devstack sudo[100587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a
Jul 17 03:52:12 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:13 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:13 devstack sudo[100592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a
Jul 17 03:52:13 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:13 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-13574450-2650-4468-b7f5-83bdbfd1341a" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Lock "cinder-quobyte-13574450-2650-4468-b7f5-83bdbfd1341a" released by "delete_volume" :: held 0.710s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Created reservations ['e59ad301-701a-4a67-9b6a-8d3908084fd2', 'd86987c1-cdcd-40bf-9509-d89d6e84e9bc', '8e11185d-dc6f-4c42-9370-300197a1c339', 'ab393da2-f4c0-42f9-bf95-2ac7c18d611f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:13 devstack sudo[100595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:13 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:13 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Deleted volume successfully.
Jul 17 03:52:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db8693b9-38f3-4beb-a4e7-d8508247f62d tempest-ProjectReaderTests-308198121 None] Lock "cinder-13574450-2650-4468-b7f5-83bdbfd1341a-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Flow 'volume_create_manager' (a25eb800-cc2a-48b1-92a7-23919f991c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1981bf3f-aaba-48e2-b750-063e1c45e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1981bf3f-aaba-48e2-b750-063e1c45e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699781438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07328469-2dc7-44e5-949a-ace82eb48a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20539ace8149229df3a5252cf19ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:14Z,use_quota=True,user_id='95172bf000a34980b7ed72630b9a022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65663fb-301e-434a-adb5-5f93023f7b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65663fb-301e-434a-adb5-5f93023f7b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf54b1e-8f11-449f-bd3b-bc6f38f3b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf54b1e-8f11-449f-bd3b-bc6f38f3b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07328469-2dc7-44e5-949a-ace82eb48a58', 'volume_name': 'volume-07328469-2dc7-44e5-949a-ace82eb48a58', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75622958-5e50-409c-878c-acdd35a9b67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75622958-5e50-409c-878c-acdd35a9b67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fc9e37-25f3-4b70-8dd6-181b69c17ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Volume 07328469-2dc7-44e5-949a-ace82eb48a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07328469-2dc7-44e5-949a-ace82eb48a58', 'volume_size': 1}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1699781438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07328469-2dc7-44e5-949a-ace82eb48a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20539ace8149229df3a5252cf19ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:14Z,use_quota=True,user_id='95172bf000a34980b7ed72630b9a022f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Creating volume 07328469-2dc7-44e5-949a-ace82eb48a58 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:14 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58 1073741824
Jul 17 03:52:14 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:14 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58 1073741824" returned: 0 in 0.448s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:14 devstack sudo[100604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58
Jul 17 03:52:14 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:15 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5fc9e37-25f3-4b70-8dd6-181b69c17ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07328469-2dc7-44e5-949a-ace82eb48a58', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463a17e-f9fd-45f7-8630-9d1395f0c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Volume volume-07328469-2dc7-44e5-949a-ace82eb48a58 (07328469-2dc7-44e5-949a-ace82eb48a58): created successfully
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5463a17e-f9fd-45f7-8630-9d1395f0c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Flow 'volume_create_manager' (a25eb800-cc2a-48b1-92a7-23919f991c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3b1a4465-897d-49d1-979c-5422b59c8976 tempest-ProjectReaderTests-308198121 None] Created volume successfully.
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Acquiring lock "cinder-07328469-2dc7-44e5-949a-ace82eb48a58-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Lock "cinder-07328469-2dc7-44e5-949a-ace82eb48a58-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Acquiring lock "cinder-quobyte-07328469-2dc7-44e5-949a-ace82eb48a58" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Lock "cinder-quobyte-07328469-2dc7-44e5-949a-ace82eb48a58" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d51c49d-4fc5-42f8-bef0-7e9ef85172c4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:15 devstack sudo[100607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58
Jul 17 03:52:15 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:15 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:15 devstack sudo[100613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58
Jul 17 03:52:15 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:15 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-07328469-2dc7-44e5-949a-ace82eb48a58" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Lock "cinder-quobyte-07328469-2dc7-44e5-949a-ace82eb48a58" released by "delete_volume" :: held 0.662s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Created reservations ['a35feba6-ea03-4cc4-8f99-2ee5de84ac77', '1a303dd5-2f39-4a27-bd79-99b9a8591f31', 'fe7feb98-1fe5-4043-ad8e-a49df88341f9', 'a6c8cc8d-2a75-4a10-979a-a865d867a4ed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:16 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:16 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:16 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.257s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Deleted volume successfully.
Jul 17 03:52:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d7660046-3a93-4de6-a9b6-79115f411dc3 tempest-ProjectReaderTests-308198121 None] Lock "cinder-07328469-2dc7-44e5-949a-ace82eb48a58-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:25 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Flow 'volume_create_manager' (89300c87-c551-44b1-b7c6-4981e69eb7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea9525e-b101-40ac-837e-777c122d2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea9525e-b101-40ac-837e-777c122d2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106887958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37228e8-9401-4c57-9d76-ead27395e5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1de9ca1f034f92a5b3fa0102e3ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:26Z,use_quota=True,user_id='43c367cd6beb4847b1e9c5f459334544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fedd13-8dd0-4e31-9a50-898536b79d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fedd13-8dd0-4e31-9a50-898536b79d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2e5b89-89ea-40e1-8359-b7d335062f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a2e5b89-89ea-40e1-8359-b7d335062f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37228e8-9401-4c57-9d76-ead27395e5fe', 'volume_name': 'volume-f37228e8-9401-4c57-9d76-ead27395e5fe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2848b024-714d-4059-84e8-bf1389fcaa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2848b024-714d-4059-84e8-bf1389fcaa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba5750b-e5b8-467c-9cdd-d44877bb284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Volume f37228e8-9401-4c57-9d76-ead27395e5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37228e8-9401-4c57-9d76-ead27395e5fe', 'volume_size': 1}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106887958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37228e8-9401-4c57-9d76-ead27395e5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1de9ca1f034f92a5b3fa0102e3ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:26Z,use_quota=True,user_id='43c367cd6beb4847b1e9c5f459334544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Creating volume f37228e8-9401-4c57-9d76-ead27395e5fe {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:26 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:26 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe 1073741824
Jul 17 03:52:26 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:26 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe 1073741824" returned: 0 in 0.428s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:26 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe
Jul 17 03:52:26 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:26 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba5750b-e5b8-467c-9cdd-d44877bb284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37228e8-9401-4c57-9d76-ead27395e5fe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eba4641-ae1e-477c-9506-0a007772b247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Volume volume-f37228e8-9401-4c57-9d76-ead27395e5fe (f37228e8-9401-4c57-9d76-ead27395e5fe): created successfully
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eba4641-ae1e-477c-9506-0a007772b247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Flow 'volume_create_manager' (89300c87-c551-44b1-b7c6-4981e69eb7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-88edd336-9630-4da5-b225-6ce53d421ecb tempest-VolumeQuotasAdminTestJSON-1358449798 None] Created volume successfully.
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Acquiring lock "cinder-f37228e8-9401-4c57-9d76-ead27395e5fe-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "cinder-f37228e8-9401-4c57-9d76-ead27395e5fe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Acquiring lock "cinder-quobyte-f37228e8-9401-4c57-9d76-ead27395e5fe" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "cinder-quobyte-f37228e8-9401-4c57-9d76-ead27395e5fe" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4bdb95-1c99-484d-86c5-f2cd9fe8e907]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:27 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe
Jul 17 03:52:27 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:27 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:27 devstack sudo[100639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe
Jul 17 03:52:27 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:27 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f37228e8-9401-4c57-9d76-ead27395e5fe" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "cinder-quobyte-f37228e8-9401-4c57-9d76-ead27395e5fe" released by "delete_volume" :: held 0.731s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Created reservations ['c482038a-8785-425e-8750-2aec13ff20d4', 'eed66f55-31e5-4cd1-8ecb-60e548d39560', 'eacce64f-e540-456a-a1d9-7186a618b33b', '426db080-1100-4ce5-9502-5993515aa092'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:28 devstack sudo[100642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:28 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:28 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Deleted volume successfully.
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e16012b3-2f60-4e08-b601-c4e04d60ffc7 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "cinder-f37228e8-9401-4c57-9d76-ead27395e5fe-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Flow 'volume_create_manager' (afa8757c-526c-4841-a831-b5f8a562c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d83a28-327d-412d-b633-eb43b8abf31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d83a28-327d-412d-b633-eb43b8abf31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1392409176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ea2fda-b6e1-45b4-b9b5-78973696057d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1de9ca1f034f92a5b3fa0102e3ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:29Z,use_quota=True,user_id='43c367cd6beb4847b1e9c5f459334544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8a5fa7-870b-4b51-9f43-b86c6b696b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8a5fa7-870b-4b51-9f43-b86c6b696b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31f0d27-9a0e-4875-8dc3-c9b583c70b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c31f0d27-9a0e-4875-8dc3-c9b583c70b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ea2fda-b6e1-45b4-b9b5-78973696057d', 'volume_name': 'volume-80ea2fda-b6e1-45b4-b9b5-78973696057d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e72a14-cd26-4fe0-a939-174d85cc33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e72a14-cd26-4fe0-a939-174d85cc33a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6178d2f7-02b3-4dbb-93d1-3c543796d38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Volume 80ea2fda-b6e1-45b4-b9b5-78973696057d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ea2fda-b6e1-45b4-b9b5-78973696057d', 'volume_size': 1}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1392409176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ea2fda-b6e1-45b4-b9b5-78973696057d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1de9ca1f034f92a5b3fa0102e3ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:29Z,use_quota=True,user_id='43c367cd6beb4847b1e9c5f459334544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Creating volume 80ea2fda-b6e1-45b4-b9b5-78973696057d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:28 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d 1073741824
Jul 17 03:52:28 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:29 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d 1073741824" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:29 devstack sudo[100651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d
Jul 17 03:52:29 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:29 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6178d2f7-02b3-4dbb-93d1-3c543796d38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ea2fda-b6e1-45b4-b9b5-78973696057d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9246eeb3-4ad1-4ff7-b710-1087e6c570c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Volume volume-80ea2fda-b6e1-45b4-b9b5-78973696057d (80ea2fda-b6e1-45b4-b9b5-78973696057d): created successfully
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9246eeb3-4ad1-4ff7-b710-1087e6c570c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Flow 'volume_create_manager' (afa8757c-526c-4841-a831-b5f8a562c13a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7e6bbc56-67c3-40b9-9dd1-7ae2be01b9f1 tempest-VolumeQuotasAdminTestJSON-1358449798 None] Created volume successfully.
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=119,cinder:SELECT=108,cinder:INSERT=37,cinder:DELETE=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:52:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f782eebf-65d6-4618-862c-66c061b247bb tempest-VolumeQuotasAdminTestJSON-1168658751 None] Transfer volume completed successfully.
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Acquiring lock "cinder-80ea2fda-b6e1-45b4-b9b5-78973696057d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Lock "cinder-80ea2fda-b6e1-45b4-b9b5-78973696057d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=98,cinder:UPDATE=129,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Acquiring lock "cinder-quobyte-80ea2fda-b6e1-45b4-b9b5-78973696057d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Lock "cinder-quobyte-80ea2fda-b6e1-45b4-b9b5-78973696057d" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed09cf5-a692-410c-81d4-ce19685fb3ca]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:30 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d
Jul 17 03:52:30 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:31 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:31 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d
Jul 17 03:52:31 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:31 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-80ea2fda-b6e1-45b4-b9b5-78973696057d" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Lock "cinder-quobyte-80ea2fda-b6e1-45b4-b9b5-78973696057d" released by "delete_volume" :: held 0.638s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Created reservations ['a8c94766-c1f4-4213-b4b1-ef160ca21d53', '378c9d21-1865-48ce-b31f-fa77651b22ef', 'c27d5e93-25ad-4325-9b0f-7067b12b7880', 'f9f3340d-1724-4fd5-84a5-18caedffb8a5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:31 devstack sudo[100662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:31 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:31 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Deleted volume successfully.
Jul 17 03:52:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96fe7055-e508-4121-b951-244ab5e11ce4 tempest-VolumeQuotasAdminTestJSON-1108915171 None] Lock "cinder-80ea2fda-b6e1-45b4-b9b5-78973696057d-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Flow 'volume_create_manager' (a501b50d-fcb8-4328-b9f5-60985ab84112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb42ba3-6217-4097-9eb4-55446eac70c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ceb42ba3-6217-4097-9eb4-55446eac70c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1946315943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9814efea-4c75-41bd-8d20-10075c3eb0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076e369ccf7544839e04b8aeb98ed1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:38Z,use_quota=True,user_id='eb5ad80707d94555b7cadc0f9ec7fdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbefc414-9104-41d9-b694-74e9e66b28f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbefc414-9104-41d9-b694-74e9e66b28f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40536d5-79c0-4509-9577-4feb533702ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40536d5-79c0-4509-9577-4feb533702ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9814efea-4c75-41bd-8d20-10075c3eb0d9', 'volume_name': 'volume-9814efea-4c75-41bd-8d20-10075c3eb0d9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff302cce-d5e6-499e-9f86-7cd784269b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff302cce-d5e6-499e-9f86-7cd784269b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9604c19-8e41-4d84-bd50-f192522e5bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Volume 9814efea-4c75-41bd-8d20-10075c3eb0d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9814efea-4c75-41bd-8d20-10075c3eb0d9', 'volume_size': 1}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1946315943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9814efea-4c75-41bd-8d20-10075c3eb0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='076e369ccf7544839e04b8aeb98ed1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:38Z,use_quota=True,user_id='eb5ad80707d94555b7cadc0f9ec7fdc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Creating volume 9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:38 devstack sudo[100702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 1073741824
Jul 17 03:52:38 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:38 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 1073741824" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:38 devstack sudo[100707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9
Jul 17 03:52:38 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:39 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9604c19-8e41-4d84-bd50-f192522e5bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9814efea-4c75-41bd-8d20-10075c3eb0d9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a688a31b-21dc-4066-b062-67b46be73258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Volume volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 (9814efea-4c75-41bd-8d20-10075c3eb0d9): created successfully
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a688a31b-21dc-4066-b062-67b46be73258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Flow 'volume_create_manager' (a501b50d-fcb8-4328-b9f5-60985ab84112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-55ff96b4-52a6-4842-8501-acc6e55f3484 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Created volume successfully.
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Creating offline snapshot 7d949ecc-1826-4f33-9ce0-cc73ba071a68 of volume 9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da71aae-ef70-4c5b-b6f8-7f3ae092b5e9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:39 devstack sudo[100710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9
Jul 17 03:52:39 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:39 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:39 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 1G
Jul 17 03:52:39 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:40 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 1G" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:40 devstack sudo[100721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68
Jul 17 03:52:40 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:40 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:40 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 is being set with open permissions: ugo+rw
Jul 17 03:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:40 devstack sudo[100727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68
Jul 17 03:52:40 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:40 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:40 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.info
Jul 17 03:52:40 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:41 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.info" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.info is being set with open permissions: ugo+rw
Jul 17 03:52:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:41 devstack sudo[100733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.info
Jul 17 03:52:41 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:41 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-699f3ee5-2522-4c2e-918e-263713fa1554 tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Create snapshot completed successfully
Jul 17 03:52:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "cinder-7d949ecc-1826-4f33-9ce0-cc73ba071a68-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-7d949ecc-1826-4f33-9ce0-cc73ba071a68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "cinder-quobyte-9814efea-4c75-41bd-8d20-10075c3eb0d9" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-quobyte-9814efea-4c75-41bd-8d20-10075c3eb0d9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "cinder-quobyte-7d949ecc-1826-4f33-9ce0-cc73ba071a68" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-quobyte-7d949ecc-1826-4f33-9ce0-cc73ba071a68" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Deleting offline snapshot 7d949ecc-1826-4f33-9ce0-cc73ba071a68 of volume 9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] snapshot_file for this snap is: volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2118d030-a2b8-4c82-885e-65083eb91390]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:42 devstack sudo[100737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68
Jul 17 03:52:42 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:42 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9814efea-4c75-41bd-8d20-10075c3eb0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed797a68-072e-41c9-a756-50e58941e741]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:42 devstack sudo[100742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9
Jul 17 03:52:42 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:42 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:42 devstack sudo[100747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68
Jul 17 03:52:42 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:43 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:43 devstack sudo[100752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68
Jul 17 03:52:43 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:43 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9.7d949ecc-1826-4f33-9ce0-cc73ba071a68" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-quobyte-7d949ecc-1826-4f33-9ce0-cc73ba071a68" released by "_delete_snapshot" :: held 1.389s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-quobyte-9814efea-4c75-41bd-8d20-10075c3eb0d9" released by "delete_snapshot" :: held 1.412s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Created reservations ['86dff33b-86a0-4520-b946-e885fbd97d4d', '4e590856-1e7f-43d7-9721-a2090bc2da96', 'a2d74295-2a07-45c7-a60d-e9b0daa775f4', 'e67e7376-c5b5-4307-a863-e20e809223d3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Delete snapshot completed successfully.
Jul 17 03:52:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c005329a-2e50-4196-829f-f2532e0fdccc tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-7d949ecc-1826-4f33-9ce0-cc73ba071a68-delete_snapshot" released by "delete_snapshot" :: held 1.537s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "cinder-9814efea-4c75-41bd-8d20-10075c3eb0d9-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-9814efea-4c75-41bd-8d20-10075c3eb0d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "cinder-quobyte-9814efea-4c75-41bd-8d20-10075c3eb0d9" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-quobyte-9814efea-4c75-41bd-8d20-10075c3eb0d9" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1751374-39a2-4326-bc08-21ad9d0f57d5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:44 devstack sudo[100755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9
Jul 17 03:52:44 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:44 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:44 devstack sudo[100760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9
Jul 17 03:52:44 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:44 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9814efea-4c75-41bd-8d20-10075c3eb0d9" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-quobyte-9814efea-4c75-41bd-8d20-10075c3eb0d9" released by "delete_volume" :: held 0.695s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Created reservations ['f650f58f-80e7-4c2f-b1a4-ef279a72964d', '6f57fb96-ee84-46f1-84ab-ebdb2d6fdeea', '218b2c8c-1340-4dbd-8186-47ea2389919d', '96b4a1bf-ae34-49c4-b1f4-c010fbb82167'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:45 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:45 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:45 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Deleted volume successfully.
Jul 17 03:52:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2e80e94c-dc6a-4fee-b249-758dd119430a tempest-VolumeSnapshotQuotasNegativeTestJSON-699488575 None] Lock "cinder-9814efea-4c75-41bd-8d20-10075c3eb0d9-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Flow 'volume_create_manager' (1b76897f-575a-48af-8956-86141b5369b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c239b45a-ad43-4c36-b350-7981a857ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c239b45a-ad43-4c36-b350-7981a857ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2013481658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0705ba88-c2ef-4aba-ae37-50d33aad4a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cf695ec90e439e89465e1b4039e986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:51Z,use_quota=True,user_id='e82152322c2f4c93a46a63584908ef81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dfdead3-475f-4f9b-820f-3271e9be0ed1),volume_type_id=8dfdead3-475f-4f9b-820f-3271e9be0ed1)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cf0d5c-fae9-4b21-ac21-4a7ec501880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16cf0d5c-fae9-4b21-ac21-4a7ec501880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15863fe3-2eae-4ee5-a616-f3e8e7e4bd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15863fe3-2eae-4ee5-a616-f3e8e7e4bd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0705ba88-c2ef-4aba-ae37-50d33aad4a76', 'volume_name': 'volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0d64de-3373-495a-8809-824c9797b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0d64de-3373-495a-8809-824c9797b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fccb7a7-196d-4e88-8a3b-52b24959dc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Volume 0705ba88-c2ef-4aba-ae37-50d33aad4a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76', 'volume_size': 1}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2013481658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0705ba88-c2ef-4aba-ae37-50d33aad4a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50cf695ec90e439e89465e1b4039e986',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:51Z,use_quota=True,user_id='e82152322c2f4c93a46a63584908ef81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8dfdead3-475f-4f9b-820f-3271e9be0ed1),volume_type_id=8dfdead3-475f-4f9b-820f-3271e9be0ed1)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Creating volume 0705ba88-c2ef-4aba-ae37-50d33aad4a76 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:50 devstack sudo[100773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76 1073741824
Jul 17 03:52:50 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:51 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76 1073741824" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:51 devstack sudo[100778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76
Jul 17 03:52:51 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:51 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fccb7a7-196d-4e88-8a3b-52b24959dc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67dc31d4-91a3-4509-9240-85dfda55fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Volume volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76 (0705ba88-c2ef-4aba-ae37-50d33aad4a76): created successfully
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67dc31d4-91a3-4509-9240-85dfda55fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Flow 'volume_create_manager' (1b76897f-575a-48af-8956-86141b5369b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6c2e47b2-aad9-41b3-b4ca-96b114c4843a tempest-VolumeTypesAccessTest-243649895 None] Created volume successfully.
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Acquiring lock "cinder-0705ba88-c2ef-4aba-ae37-50d33aad4a76-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Lock "cinder-0705ba88-c2ef-4aba-ae37-50d33aad4a76-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Acquiring lock "cinder-quobyte-0705ba88-c2ef-4aba-ae37-50d33aad4a76" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Lock "cinder-quobyte-0705ba88-c2ef-4aba-ae37-50d33aad4a76" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62ee2e0-37c1-4ecb-b318-b31d782317e5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:51 devstack sudo[100781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76
Jul 17 03:52:51 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:52 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:52 devstack sudo[100786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76
Jul 17 03:52:52 devstack sudo[100786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:52 devstack sudo[100786]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0705ba88-c2ef-4aba-ae37-50d33aad4a76" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Lock "cinder-quobyte-0705ba88-c2ef-4aba-ae37-50d33aad4a76" released by "delete_volume" :: held 0.629s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:52 devstack cinder-volume[87498]: WARNING cinder.quota [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-696869141 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-696869141, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:52:52 devstack cinder-volume[87498]: WARNING cinder.quota [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-696869141 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-696869141, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Created reservations ['6cc7cc11-998f-49c5-8b56-162150de6fc5', '62bb48f4-7eae-477a-b45f-3f67358b46c5', '5b9838bd-00fb-4d96-b3ad-9b60f704a9e6', 'e043a866-0dbd-4cb0-9048-6f791bbc8d8e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:52 devstack sudo[100789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:52:52 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:52 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:52:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Deleted volume successfully.
Jul 17 03:52:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e08a817-d86a-4b75-8bf2-79f7fae17202 tempest-VolumeTypesAccessTest-243649895 None] Lock "cinder-0705ba88-c2ef-4aba-ae37-50d33aad4a76-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Flow 'volume_create_manager' (68481167-3526-4e1c-895b-ea4d2f9d3c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6870e663-16ee-4835-a57e-a334fe272cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6870e663-16ee-4835-a57e-a334fe272cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1289075123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da5667f-d650-4239-af0f-2cd44a04b7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a928af8c7c4096955b00828c92f942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:59Z,use_quota=True,user_id='02408976f14a420e8d29cdf938be1aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b2c994-9f60-41b9-aeaa-71cc7f84a5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b2c994-9f60-41b9-aeaa-71cc7f84a5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a42b2b-d418-487f-9690-2c8a1c313c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a42b2b-d418-487f-9690-2c8a1c313c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da5667f-d650-4239-af0f-2cd44a04b7a0', 'volume_name': 'volume-2da5667f-d650-4239-af0f-2cd44a04b7a0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbaf0e7-02ee-4744-9717-c39c558745fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbaf0e7-02ee-4744-9717-c39c558745fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912831fc-70c6-4bc9-8674-da4298b0e8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Volume 2da5667f-d650-4239-af0f-2cd44a04b7a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da5667f-d650-4239-af0f-2cd44a04b7a0', 'volume_size': 1}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1289075123',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da5667f-d650-4239-af0f-2cd44a04b7a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11a928af8c7c4096955b00828c92f942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:52:59Z,use_quota=True,user_id='02408976f14a420e8d29cdf938be1aec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Creating volume 2da5667f-d650-4239-af0f-2cd44a04b7a0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:52:58 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:58 devstack sudo[100794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0 1073741824
Jul 17 03:52:58 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:59 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0 1073741824" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:52:59 devstack sudo[100799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0
Jul 17 03:52:59 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:52:59 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912831fc-70c6-4bc9-8674-da4298b0e8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da5667f-d650-4239-af0f-2cd44a04b7a0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115dda0d-8ea7-4ec4-bae9-1b5764eb7974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:52:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Volume volume-2da5667f-d650-4239-af0f-2cd44a04b7a0 (2da5667f-d650-4239-af0f-2cd44a04b7a0): created successfully
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (115dda0d-8ea7-4ec4-bae9-1b5764eb7974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Flow 'volume_create_manager' (68481167-3526-4e1c-895b-ea4d2f9d3c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:52:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ed6f8567-789b-42d1-89ee-0a9246d40e90 tempest-AbsoluteLimitsTests-859446127 None] Created volume successfully.
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Acquiring lock "cinder-2da5667f-d650-4239-af0f-2cd44a04b7a0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Lock "cinder-2da5667f-d650-4239-af0f-2cd44a04b7a0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Acquiring lock "cinder-quobyte-2da5667f-d650-4239-af0f-2cd44a04b7a0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Lock "cinder-quobyte-2da5667f-d650-4239-af0f-2cd44a04b7a0" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[465e82a7-46ba-4f4d-b01f-c704b0635e95]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:00 devstack sudo[100802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0
Jul 17 03:53:00 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:00 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:00 devstack sudo[100807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0
Jul 17 03:53:00 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:00 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-2da5667f-d650-4239-af0f-2cd44a04b7a0" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Lock "cinder-quobyte-2da5667f-d650-4239-af0f-2cd44a04b7a0" released by "delete_volume" :: held 0.621s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Created reservations ['c62bae02-7581-4cd7-921e-0d6c6dfff92e', '9788d767-ac66-484b-92e6-627ed7088ba0', '40792569-3316-48b7-81d3-5ff1dacc8fd7', '30aa0d21-76f8-4457-abbd-be41b4bb3889'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:00 devstack sudo[100810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:00 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:00 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Deleted volume successfully.
Jul 17 03:53:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6a849633-508d-4a07-b915-a002982b0eee tempest-AbsoluteLimitsTests-859446127 None] Lock "cinder-2da5667f-d650-4239-af0f-2cd44a04b7a0-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Flow 'volume_create_manager' (44e47945-ba3a-4c49-9e4d-5e1c6b88dd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730f9aed-631f-46b4-a298-2edeb74361e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730f9aed-631f-46b4-a298-2edeb74361e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2124833368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe63bfd2-de2c-4edd-a734-fbec244cb71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367ce239c5454984b7cc490292565b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:04Z,use_quota=True,user_id='ef184f24412d49f4bded358a7548b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e023ac77-633a-4e04-804c-4198fce0ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e023ac77-633a-4e04-804c-4198fce0ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2d4dea-ba4e-4c35-86af-1883ccd1f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2d4dea-ba4e-4c35-86af-1883ccd1f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe63bfd2-de2c-4edd-a734-fbec244cb71a', 'volume_name': 'volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e847dc27-110f-4619-b71d-b2caf7866824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e847dc27-110f-4619-b71d-b2caf7866824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42802faf-fafb-4619-8a16-2f8f8dc4063a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Volume fe63bfd2-de2c-4edd-a734-fbec244cb71a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a', 'volume_size': 1}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2124833368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe63bfd2-de2c-4edd-a734-fbec244cb71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367ce239c5454984b7cc490292565b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:04Z,use_quota=True,user_id='ef184f24412d49f4bded358a7548b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Creating volume fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:04 devstack sudo[100814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a 1073741824
Jul 17 03:53:04 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:05 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a 1073741824" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:05 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a
Jul 17 03:53:05 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:05 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42802faf-fafb-4619-8a16-2f8f8dc4063a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eef3a05-c5c6-48c9-aedf-2325c7a35224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Volume volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a (fe63bfd2-de2c-4edd-a734-fbec244cb71a): created successfully
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eef3a05-c5c6-48c9-aedf-2325c7a35224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Flow 'volume_create_manager' (44e47945-ba3a-4c49-9e4d-5e1c6b88dd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2fd017fd-656f-4bad-aee8-12e36ea4069e tempest-VolumesDeleteCascade-1822481106 None] Created volume successfully.
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Creating offline snapshot 178a78a8-6f02-4c4d-ae43-b0f037de4b3f of volume fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4a9be7-bcc9-434a-8532-99889db286fa]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:05 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a
Jul 17 03:53:05 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:06 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:06 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f 1G
Jul 17 03:53:06 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:06 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f 1G" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:06 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f
Jul 17 03:53:06 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:06 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:06 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f is being set with open permissions: ugo+rw
Jul 17 03:53:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:06 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f
Jul 17 03:53:06 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:07 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:07 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.info
Jul 17 03:53:07 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:07 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.info" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:07 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.info is being set with open permissions: ugo+rw
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:07 devstack sudo[100846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.info
Jul 17 03:53:07 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:07 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.info" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eac6d297-6402-4c57-8b8b-27f0d0698a83 tempest-VolumesDeleteCascade-1822481106 None] Create snapshot completed successfully
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Creating offline snapshot 03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f of volume fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f5c8f0-d931-40a9-9fba-443201930532]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:08 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f
Jul 17 03:53:08 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:08 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:53:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:08 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f 1G
Jul 17 03:53:08 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:08 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f 1G" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:08 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f
Jul 17 03:53:08 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:09 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f is being set with open permissions: ugo+rw
Jul 17 03:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:09 devstack sudo[100864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f
Jul 17 03:53:09 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:09 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.383s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-db16199f-df85-47fb-b2fe-887bf6a0c0fc tempest-VolumesDeleteCascade-1822481106 None] Create snapshot completed successfully
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-fe63bfd2-de2c-4edd-a734-fbec244cb71a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-fe63bfd2-de2c-4edd-a734-fbec244cb71a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Performing cascade delete. {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Deleting offline snapshot 03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f of volume fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] snapshot_file for this snap is: volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b3e0b2-9db6-40ae-9185-31640963dffb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:10 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f
Jul 17 03:53:10 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:10 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[af566049-7ccd-4bf3-b5cb-58348ec108bf]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:10 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f
Jul 17 03:53:10 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:10 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:10 devstack sudo[100877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f
Jul 17 03:53:10 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:11 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:11 devstack sudo[100882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f
Jul 17 03:53:11 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:11 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f" released by "_delete_snapshot" :: held 1.385s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" released by "delete_snapshot" :: held 1.405s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Created reservations ['3e566dd3-0752-45a7-a051-4edea52c1a7e', '83a4c0dd-642e-4e17-8332-ea2ff06bac12', '69f6d958-ce54-411a-87b6-15db100c1210', 'b4148f6b-a8bd-4263-ae77-0e75899239f7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Delete snapshot completed successfully.
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-03fdeaf7-ce6b-4d41-8cbb-6e20f6759e9f-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-178a78a8-6f02-4c4d-ae43-b0f037de4b3f-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-178a78a8-6f02-4c4d-ae43-b0f037de4b3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-178a78a8-6f02-4c4d-ae43-b0f037de4b3f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-178a78a8-6f02-4c4d-ae43-b0f037de4b3f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Deleting offline snapshot 178a78a8-6f02-4c4d-ae43-b0f037de4b3f of volume fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] snapshot_file for this snap is: volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c4585a-e18d-496d-b235-1c7d9bf5db67]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:11 devstack sudo[100885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f
Jul 17 03:53:11 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:12 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eec614-0fbf-462a-9579-00c2314c66d3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:12 devstack sudo[100891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a
Jul 17 03:53:12 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:12 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:12 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:12 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:53:12 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:12 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f
Jul 17 03:53:12 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:12 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:12 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f
Jul 17 03:53:12 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:13 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a.178a78a8-6f02-4c4d-ae43-b0f037de4b3f" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-178a78a8-6f02-4c4d-ae43-b0f037de4b3f" released by "_delete_snapshot" :: held 1.372s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" released by "delete_snapshot" :: held 1.397s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Created reservations ['cc3c5b1c-e0a5-409e-b7ca-894eda228a3d', 'f0bcaf83-c6c8-43d2-84a0-ead434ffdde8', '19e0b9ec-9a24-46e0-9c3d-17a66263e752', 'c47f5827-0767-4754-9363-944ac13af027'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Delete snapshot completed successfully.
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-178a78a8-6f02-4c4d-ae43-b0f037de4b3f-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Snapshots deleted, issuing volume delete {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" acquired by "delete_volume" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eb6ee6-250a-40b7-9f83-902325044941]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:13 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a
Jul 17 03:53:13 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:13 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:13 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a
Jul 17 03:53:13 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:13 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-fe63bfd2-de2c-4edd-a734-fbec244cb71a" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-fe63bfd2-de2c-4edd-a734-fbec244cb71a" released by "delete_volume" :: held 0.663s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Created reservations ['d7c89de6-dab5-4f6d-9678-f3ad7aa725fb', '6012a97a-2800-483b-a5ea-55fa5245804a', 'ecfb4a9f-22e7-4d18-baf3-2d2b129d8749', '80ee2dde-9bc1-4043-8603-ebb5b4af3425'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:14 devstack sudo[100915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:14 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:14 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Deleted volume successfully.
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d616695-89e8-4ca1-969c-e5b585d6010f tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-fe63bfd2-de2c-4edd-a734-fbec244cb71a-delete_volume" released by "delete_volume" :: held 4.198s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Flow 'volume_create_manager' (10565f23-5976-47c9-a9e8-501b677fb5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b906ae7-596b-4b4c-bac8-0866011654f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b906ae7-596b-4b4c-bac8-0866011654f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1201726582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f6dac5-71ad-4b97-a510-326f67440576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367ce239c5454984b7cc490292565b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:15Z,use_quota=True,user_id='ef184f24412d49f4bded358a7548b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f025f45-2f82-4579-a313-92ccb285f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f025f45-2f82-4579-a313-92ccb285f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1d58a4-09f6-4f8e-804d-fcfab6b7b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1d58a4-09f6-4f8e-804d-fcfab6b7b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f6dac5-71ad-4b97-a510-326f67440576', 'volume_name': 'volume-b6f6dac5-71ad-4b97-a510-326f67440576', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed183b1a-5521-4766-ab27-144e3e107a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed183b1a-5521-4766-ab27-144e3e107a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450afe24-8bfa-4881-858d-01de3234b567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Volume b6f6dac5-71ad-4b97-a510-326f67440576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f6dac5-71ad-4b97-a510-326f67440576', 'volume_size': 1}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1201726582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f6dac5-71ad-4b97-a510-326f67440576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367ce239c5454984b7cc490292565b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:15Z,use_quota=True,user_id='ef184f24412d49f4bded358a7548b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Creating volume b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:15 devstack sudo[100920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 1073741824
Jul 17 03:53:15 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:15 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 1073741824" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:15 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576
Jul 17 03:53:15 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:15 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450afe24-8bfa-4881-858d-01de3234b567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f6dac5-71ad-4b97-a510-326f67440576', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a6762e-d807-44c6-971d-a3cc9637b1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Volume volume-b6f6dac5-71ad-4b97-a510-326f67440576 (b6f6dac5-71ad-4b97-a510-326f67440576): created successfully
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a6762e-d807-44c6-971d-a3cc9637b1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Flow 'volume_create_manager' (10565f23-5976-47c9-a9e8-501b677fb5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-636c8189-f91f-46b6-a1aa-315e06224fab tempest-VolumesDeleteCascade-1822481106 None] Created volume successfully.
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Creating offline snapshot 1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 of volume b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d75a372-8c70-437b-ac57-e4bd6b6341ec]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:16 devstack sudo[100929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576
Jul 17 03:53:16 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:16 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:16 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 1G
Jul 17 03:53:16 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:16 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 1G" returned: 0 in 0.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f6dac5-71ad-4b97-a510-326f67440576 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:16 devstack sudo[100939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f6dac5-71ad-4b97-a510-326f67440576 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3
Jul 17 03:53:16 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:17 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f6dac5-71ad-4b97-a510-326f67440576 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 is being set with open permissions: ugo+rw
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:17 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3
Jul 17 03:53:17 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:17 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:17 devstack sudo[100947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.info
Jul 17 03:53:17 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:17 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.info" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.info is being set with open permissions: ugo+rw
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:17 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.info
Jul 17 03:53:17 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:17 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c3c2af3a-e0e0-4eca-994d-4c04b1cc2b4b tempest-VolumesDeleteCascade-1822481106 None] Create snapshot completed successfully
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Flow 'volume_create_manager' (5e9e7bb1-cd49-47d0-9bcc-ae6c48b6914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3fdfe-df0b-4bb7-8b23-c3bf3ff2b927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3fdfe-df0b-4bb7-8b23-c3bf3ff2b927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1070446764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fbc2fd-3c55-469a-b812-bc1b6df603fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='367ce239c5454984b7cc490292565b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:19Z,use_quota=True,user_id='ef184f24412d49f4bded358a7548b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9fdf18-3a8b-45a0-8593-8e78bad57b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9fdf18-3a8b-45a0-8593-8e78bad57b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2065b1a0-50a6-4d10-b02a-e23acc394035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2065b1a0-50a6-4d10-b02a-e23acc394035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1fbc2fd-3c55-469a-b812-bc1b6df603fd', 'volume_name': 'volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd', 'volume_size': 1, 'snapshot_id': '1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4e9227-6c3b-435f-8b99-6239a04553b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a4e9227-6c3b-435f-8b99-6239a04553b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c2f499-0b29-4cd7-910f-a6599be37d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Volume d1fbc2fd-3c55-469a-b812-bc1b6df603fd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd', 'volume_size': 1, 'snapshot_id': '1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3'}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Creating volume d1fbc2fd-3c55-469a-b812-bc1b6df603fd from snapshot 1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] snapshot: 1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3, volume: d1fbc2fd-3c55-469a-b812-bc1b6df603fd,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ec5620-25cb-4a09-9b63-8b9114e04557]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:18 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3
Jul 17 03:53:18 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:19 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f6dac5-71ad-4b97-a510-326f67440576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc27651-4dd1-4640-963b-c266a2782f60]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:19 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576
Jul 17 03:53:19 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:19 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:19 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd
Jul 17 03:53:19 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:23 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" returned: 0 in 4.030s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[884bf748-6774-48e6-9f3d-f855506e2385]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:23 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576
Jul 17 03:53:23 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:24 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576" returned: 0 in 0.539s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:53:24 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Converted 1024.00 MB image at 253.93 MB/s
Jul 17 03:53:24 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd is being set with open permissions: ugo+rw
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:24 devstack sudo[100981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd
Jul 17 03:53:24 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:24 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" released by "_copy_volume_from_snapshot" :: held 5.573s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" released by "_create_volume_from_snapshot" :: held 5.599s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.615s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c2f499-0b29-4cd7-910f-a6599be37d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd', 'volume_size': 1, 'snapshot_id': '1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bda5fa2-a047-4be3-9c9b-e70436d92e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Volume volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd (d1fbc2fd-3c55-469a-b812-bc1b6df603fd): created successfully
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bda5fa2-a047-4be3-9c9b-e70436d92e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Flow 'volume_create_manager' (5e9e7bb1-cd49-47d0-9bcc-ae6c48b6914a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c7faeea6-86a2-4094-b549-cb0ded7b88a4 tempest-VolumesDeleteCascade-1822481106 None] Created volume successfully.
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-b6f6dac5-71ad-4b97-a510-326f67440576-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-b6f6dac5-71ad-4b97-a510-326f67440576-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Performing cascade delete. {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-b6f6dac5-71ad-4b97-a510-326f67440576" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-b6f6dac5-71ad-4b97-a510-326f67440576" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Deleting offline snapshot 1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 of volume b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] snapshot_file for this snap is: volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[892fa7d6-da28-45f6-a775-df240475e0f7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:25 devstack sudo[100984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3
Jul 17 03:53:25 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:25 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f6dac5-71ad-4b97-a510-326f67440576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[447a7b93-7398-4a47-9940-e7252b19c412]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:26 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576
Jul 17 03:53:26 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:26 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:26 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3
Jul 17 03:53:26 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:26 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:26 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3
Jul 17 03:53:26 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:26 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576.1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3" released by "_delete_snapshot" :: held 1.363s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-b6f6dac5-71ad-4b97-a510-326f67440576" released by "delete_snapshot" :: held 1.383s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Created reservations ['84367e6f-30b9-49b4-ab8b-3f0ddd4ab7f3', 'd0b6c8ca-41d1-4cea-a19a-1550ae2fc56a', '93ed2db6-382e-4b83-bc4e-d35cb9efac7a', '8b47caad-4bf5-406d-9e05-529d2977c9cc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Delete snapshot completed successfully.
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-1a6d6f06-ed8a-42c9-bc69-6db4cde09cd3-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Snapshots deleted, issuing volume delete {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-b6f6dac5-71ad-4b97-a510-326f67440576" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-b6f6dac5-71ad-4b97-a510-326f67440576" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1f6bfe-a2f6-4080-aa00-46bdaa1493d8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:27 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576
Jul 17 03:53:27 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:27 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:27 devstack sudo[101008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576
Jul 17 03:53:27 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:27 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b6f6dac5-71ad-4b97-a510-326f67440576" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-b6f6dac5-71ad-4b97-a510-326f67440576" released by "delete_volume" :: held 0.634s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Created reservations ['53ac67da-1aa7-49f1-ada9-b80be5566285', 'd3b0e637-85e3-4a13-94e4-3b262bc08271', '5a767acb-d53d-4a23-92e2-f350240dbd86', 'b7e4e114-ee38-4d6c-b9f3-1a99eac1506b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:27 devstack sudo[101011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:27 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:27 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Deleted volume successfully.
Jul 17 03:53:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-48e677fd-8af7-4651-80ce-176d25264f75 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-b6f6dac5-71ad-4b97-a510-326f67440576-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-d1fbc2fd-3c55-469a-b812-bc1b6df603fd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-d1fbc2fd-3c55-469a-b812-bc1b6df603fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "cinder-quobyte-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[224bdde7-539a-4a6b-8d9f-e23a09248dda]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:28 devstack sudo[101015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd
Jul 17 03:53:28 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:29 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:29 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd
Jul 17 03:53:29 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:29 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-quobyte-d1fbc2fd-3c55-469a-b812-bc1b6df603fd" released by "delete_volume" :: held 0.620s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Created reservations ['788ab39f-ad30-4143-9689-0154e62ef759', '4af1adc4-43a9-4868-996b-a83cefae8b70', '09e046fe-ed1e-4e99-8194-1347a6903522', '1b7203ee-5050-4395-95b4-57b8d250d5a9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:29 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:29 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:29 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Deleted volume successfully.
Jul 17 03:53:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96913ad2-9d70-476e-9591-a943f4382815 tempest-VolumesDeleteCascade-1822481106 None] Lock "cinder-d1fbc2fd-3c55-469a-b812-bc1b6df603fd-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=108,cinder:SELECT=80,cinder:INSERT=31,cinder:DELETE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=84,cinder:INSERT=21,cinder:UPDATE=94,cinder:DELETE=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Flow 'volume_create_manager' (c524a670-6197-4dc7-9d51-c49252ebf673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b84757a-d6d8-47e6-8067-3f43d0924ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b84757a-d6d8-47e6-8067-3f43d0924ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-751480149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb5efb4-af65-40af-8aac-fa2fa14f9454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41306796fb7f41d08cbd805f6271208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:34Z,use_quota=True,user_id='8339c31da9b743d6b83dc3f602c1d137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb654a3a-d7fa-4c49-9509-d82eb5a8b121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb654a3a-d7fa-4c49-9509-d82eb5a8b121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b76d1b-e514-44e2-bc7e-526903f80b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b76d1b-e514-44e2-bc7e-526903f80b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bb5efb4-af65-40af-8aac-fa2fa14f9454', 'volume_name': 'volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab2c2e0-1f02-47a1-9373-32d79b9ec260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab2c2e0-1f02-47a1-9373-32d79b9ec260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ee50fc-1e2c-418f-848c-1145540b1a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Volume 8bb5efb4-af65-40af-8aac-fa2fa14f9454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454', 'volume_size': 1}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-751480149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bb5efb4-af65-40af-8aac-fa2fa14f9454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41306796fb7f41d08cbd805f6271208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:34Z,use_quota=True,user_id='8339c31da9b743d6b83dc3f602c1d137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Creating volume 8bb5efb4-af65-40af-8aac-fa2fa14f9454 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:33 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454 1073741824
Jul 17 03:53:33 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:34 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454 1073741824" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:34 devstack sudo[101031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454
Jul 17 03:53:34 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:34 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ee50fc-1e2c-418f-848c-1145540b1a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e2c3b3-28d8-4b23-a26a-0b783bc9f97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Volume volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454 (8bb5efb4-af65-40af-8aac-fa2fa14f9454): created successfully
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e2c3b3-28d8-4b23-a26a-0b783bc9f97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Flow 'volume_create_manager' (c524a670-6197-4dc7-9d51-c49252ebf673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-47c9dfd7-a68c-47a1-8e45-41cf99dda2fc tempest-VolumesTransfersV355Test-1291100075 None] Created volume successfully.
Jul 17 03:53:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7c413712-4983-4398-99fc-de777fa99485 tempest-VolumesTransfersV355Test-1573841715 None] Transfer volume completed successfully.
Jul 17 03:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Acquiring lock "cinder-8bb5efb4-af65-40af-8aac-fa2fa14f9454-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-8bb5efb4-af65-40af-8aac-fa2fa14f9454-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Acquiring lock "cinder-quobyte-8bb5efb4-af65-40af-8aac-fa2fa14f9454" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-quobyte-8bb5efb4-af65-40af-8aac-fa2fa14f9454" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4657824-62ea-4d2e-a647-a4f439e14cbd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:36 devstack sudo[101034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454
Jul 17 03:53:36 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:36 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:36 devstack sudo[101040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454
Jul 17 03:53:36 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:36 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bb5efb4-af65-40af-8aac-fa2fa14f9454" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-quobyte-8bb5efb4-af65-40af-8aac-fa2fa14f9454" released by "delete_volume" :: held 0.632s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Created reservations ['5a7e627c-d7d6-4bdc-b91c-5580ff756def', 'fbd9b5f0-020a-471e-bd0a-84a8ec5f6cac', '3a23c28d-b709-4193-86f6-7ddf4bfe858e', '3ac8a45a-f3dd-4b79-8941-1a0076ec9dc6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:36 devstack sudo[101043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:36 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:36 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Deleted volume successfully.
Jul 17 03:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-21c687f7-c406-4733-bb7d-bf284229c24e tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-8bb5efb4-af65-40af-8aac-fa2fa14f9454-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Flow 'volume_create_manager' (458c168b-4679-4272-a578-1bd6f53ac31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8017fcb9-ec8e-4491-a103-80b6e22d49d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8017fcb9-ec8e-4491-a103-80b6e22d49d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1587162693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a1b276-306d-4157-8487-c93701e3271c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41306796fb7f41d08cbd805f6271208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:37Z,use_quota=True,user_id='8339c31da9b743d6b83dc3f602c1d137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459cd813-6098-4066-bbe4-10ba09da256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459cd813-6098-4066-bbe4-10ba09da256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ecdf06-dae4-456e-ba00-19d4916aa690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ecdf06-dae4-456e-ba00-19d4916aa690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a1b276-306d-4157-8487-c93701e3271c', 'volume_name': 'volume-a1a1b276-306d-4157-8487-c93701e3271c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fed52b-b5b8-47df-9f33-76c347f6ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0fed52b-b5b8-47df-9f33-76c347f6ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14743c8c-d2ef-4c5e-9254-855337c9f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Volume a1a1b276-306d-4157-8487-c93701e3271c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a1b276-306d-4157-8487-c93701e3271c', 'volume_size': 1}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1587162693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a1b276-306d-4157-8487-c93701e3271c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41306796fb7f41d08cbd805f6271208f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:37Z,use_quota=True,user_id='8339c31da9b743d6b83dc3f602c1d137',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Creating volume a1a1b276-306d-4157-8487-c93701e3271c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:37 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c 1073741824
Jul 17 03:53:37 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:37 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c 1073741824" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:38 devstack sudo[101088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c
Jul 17 03:53:38 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:38 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14743c8c-d2ef-4c5e-9254-855337c9f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a1b276-306d-4157-8487-c93701e3271c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3be5809-ea27-46e6-8c19-f4a9dd47c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Volume volume-a1a1b276-306d-4157-8487-c93701e3271c (a1a1b276-306d-4157-8487-c93701e3271c): created successfully
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3be5809-ea27-46e6-8c19-f4a9dd47c217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Flow 'volume_create_manager' (458c168b-4679-4272-a578-1bd6f53ac31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f6067e1f-8229-4270-b15a-b1ddca4af847 tempest-VolumesTransfersV355Test-1291100075 None] Created volume successfully.
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Acquiring lock "cinder-a1a1b276-306d-4157-8487-c93701e3271c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-a1a1b276-306d-4157-8487-c93701e3271c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Acquiring lock "cinder-quobyte-a1a1b276-306d-4157-8487-c93701e3271c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-quobyte-a1a1b276-306d-4157-8487-c93701e3271c" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[30735ada-5da4-4794-a314-b016eb75a158]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:38 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c
Jul 17 03:53:38 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:39 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:39 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c
Jul 17 03:53:39 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:39 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a1a1b276-306d-4157-8487-c93701e3271c" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-quobyte-a1a1b276-306d-4157-8487-c93701e3271c" released by "delete_volume" :: held 0.617s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Created reservations ['4e31ad52-0336-4e0c-aa79-4a18871206b5', '40d35524-c3e3-4171-a5bf-cbf8b3f045c7', 'e903b552-71db-4439-936d-60de2d3a0465', '9f0db313-fc7a-42d3-8910-a960bbb38ba1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:39 devstack sudo[101099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:39 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:39 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Deleted volume successfully.
Jul 17 03:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b29623c-b099-434c-b834-a3dab9901f07 tempest-VolumesTransfersV355Test-2129461872 None] Lock "cinder-a1a1b276-306d-4157-8487-c93701e3271c-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Flow 'volume_create_manager' (e8996cba-101c-423d-9866-5a001453bbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7149e509-1bf8-461b-a9ce-2573358581e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7149e509-1bf8-461b-a9ce-2573358581e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1819388136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9418e58-f705-40f3-bf05-06fc880e7bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daada40a893641eb8d60785b6a2c766d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:45Z,use_quota=True,user_id='c6b0d401401441998cc377d604a2ae04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aa636d-ceab-4f5e-828b-453e2a98036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aa636d-ceab-4f5e-828b-453e2a98036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b309e681-f366-45d9-8802-d9e15c3c3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b309e681-f366-45d9-8802-d9e15c3c3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9418e58-f705-40f3-bf05-06fc880e7bd1', 'volume_name': 'volume-a9418e58-f705-40f3-bf05-06fc880e7bd1', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43abf39b-1b15-439b-9530-7abef21b4983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43abf39b-1b15-439b-9530-7abef21b4983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad7af9-b6dc-4951-90bb-6c0a6c3ab981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Volume a9418e58-f705-40f3-bf05-06fc880e7bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9418e58-f705-40f3-bf05-06fc880e7bd1', 'volume_size': 2}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1819388136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9418e58-f705-40f3-bf05-06fc880e7bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daada40a893641eb8d60785b6a2c766d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:45Z,use_quota=True,user_id='c6b0d401401441998cc377d604a2ae04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Creating volume a9418e58-f705-40f3-bf05-06fc880e7bd1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1 2147483648 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:44 devstack sudo[101102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1 2147483648
Jul 17 03:53:44 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:45 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1 2147483648" returned: 0 in 0.443s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:45 devstack sudo[101107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1
Jul 17 03:53:45 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:45 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ad7af9-b6dc-4951-90bb-6c0a6c3ab981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9418e58-f705-40f3-bf05-06fc880e7bd1', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6195637-3886-492a-a052-cbe98b37ba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Volume volume-a9418e58-f705-40f3-bf05-06fc880e7bd1 (a9418e58-f705-40f3-bf05-06fc880e7bd1): created successfully
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6195637-3886-492a-a052-cbe98b37ba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Flow 'volume_create_manager' (e8996cba-101c-423d-9866-5a001453bbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a48cd865-0fdf-416c-8767-34591d8c7926 tempest-VolumesCloneNegativeTest-828220354 None] Created volume successfully.
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Acquiring lock "cinder-a9418e58-f705-40f3-bf05-06fc880e7bd1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Lock "cinder-a9418e58-f705-40f3-bf05-06fc880e7bd1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Acquiring lock "cinder-quobyte-a9418e58-f705-40f3-bf05-06fc880e7bd1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Lock "cinder-quobyte-a9418e58-f705-40f3-bf05-06fc880e7bd1" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f78f30b-51cd-4b9a-b151-d9ee2694f07e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:46 devstack sudo[101110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1
Jul 17 03:53:46 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:46 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:46 devstack sudo[101116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1
Jul 17 03:53:46 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:46 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a9418e58-f705-40f3-bf05-06fc880e7bd1" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Lock "cinder-quobyte-a9418e58-f705-40f3-bf05-06fc880e7bd1" released by "delete_volume" :: held 0.626s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Created reservations ['7d4c28dc-048e-4f67-b336-796031e03c9a', 'e78bd57c-9101-40b5-bb61-678d22e38264', '416c599c-f284-4c1c-a558-1b484269186c', 'f353ad33-e29e-46ef-8662-c332422d2a91'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:46 devstack sudo[101119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:46 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:46 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Deleted volume successfully.
Jul 17 03:53:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ccf50468-f5fc-4cfe-bed9-89ea5e8edfc6 tempest-VolumesCloneNegativeTest-828220354 None] Lock "cinder-a9418e58-f705-40f3-bf05-06fc880e7bd1-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (15580e47-68f9-4e3d-95e1-2177f3efedb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f277dd10-b119-4018-9423-1e703c4d561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f277dd10-b119-4018-9423-1e703c4d561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-918535200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7980626d-0c90-4d3e-baa6-71ecd56b1fb0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:49Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b852a8b4-389d-47f1-babf-c40157df5c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b852a8b4-389d-47f1-babf-c40157df5c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9291db-fd43-4c9a-b557-0788c7db32bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9291db-fd43-4c9a-b557-0788c7db32bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7980626d-0c90-4d3e-baa6-71ecd56b1fb0', 'volume_name': 'volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67512580-8914-4348-9cf6-3a25b5ed25d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67512580-8914-4348-9cf6-3a25b5ed25d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e9ec03-0296-401d-a709-76e01f33c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Volume 7980626d-0c90-4d3e-baa6-71ecd56b1fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0', 'volume_size': 1}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-918535200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7980626d-0c90-4d3e-baa6-71ecd56b1fb0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:49Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Creating volume 7980626d-0c90-4d3e-baa6-71ecd56b1fb0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:49 devstack sudo[101129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0 1073741824
Jul 17 03:53:49 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:50 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0 1073741824" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:50 devstack sudo[101135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0
Jul 17 03:53:50 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:50 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e9ec03-0296-401d-a709-76e01f33c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b57586f-00a2-487e-9c7d-b7fce219a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Volume volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0 (7980626d-0c90-4d3e-baa6-71ecd56b1fb0): created successfully
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b57586f-00a2-487e-9c7d-b7fce219a779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (15580e47-68f9-4e3d-95e1-2177f3efedb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f3795e5-acab-44d6-95e4-1c44b179632b tempest-VolumesGetTest-689538618 None] Created volume successfully.
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (e27c552b-b711-4f29-b640-c550239255dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6f540d-b208-4f92-b912-a01893778953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6f540d-b208-4f92-b912-a01893778953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1788476346',display_name='tempest-VolumesGetTest-Volume-1536752721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d17c9e-b4f2-497b-b507-ba237539226b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:51Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d1409a-b2db-44cf-b884-c52b8e7ce2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d1409a-b2db-44cf-b884-c52b8e7ce2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447dc924-baa3-4c69-ba49-b45e5e200d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447dc924-baa3-4c69-ba49-b45e5e200d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d17c9e-b4f2-497b-b507-ba237539226b', 'volume_name': 'volume-54d17c9e-b4f2-497b-b507-ba237539226b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a9a01c-9d12-4c8c-a1ee-909a3191012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2a9a01c-9d12-4c8c-a1ee-909a3191012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5f71e5-8357-4242-9801-e06853f20a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Volume 54d17c9e-b4f2-497b-b507-ba237539226b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d17c9e-b4f2-497b-b507-ba237539226b', 'volume_size': 1}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1788476346',display_name='tempest-VolumesGetTest-Volume-1536752721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d17c9e-b4f2-497b-b507-ba237539226b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:51Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Creating volume 54d17c9e-b4f2-497b-b507-ba237539226b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:51 devstack sudo[101138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b 1073741824
Jul 17 03:53:51 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:51 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b 1073741824" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:51 devstack sudo[101144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b
Jul 17 03:53:51 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:51 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5f71e5-8357-4242-9801-e06853f20a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d17c9e-b4f2-497b-b507-ba237539226b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59252a7f-5e07-4a11-bb3b-fb02a9b16f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Volume volume-54d17c9e-b4f2-497b-b507-ba237539226b (54d17c9e-b4f2-497b-b507-ba237539226b): created successfully
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59252a7f-5e07-4a11-bb3b-fb02a9b16f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (e27c552b-b711-4f29-b640-c550239255dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e69066f1-01ef-4eb3-b3f3-4292867fbc94 tempest-VolumesGetTest-689538618 None] Created volume successfully.
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-54d17c9e-b4f2-497b-b507-ba237539226b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Lock "cinder-54d17c9e-b4f2-497b-b507-ba237539226b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-54d17c9e-b4f2-497b-b507-ba237539226b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-54d17c9e-b4f2-497b-b507-ba237539226b" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f9cc3-2287-4fb9-a4d8-c156ceedc26c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:52 devstack sudo[101147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b
Jul 17 03:53:52 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:52 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:52 devstack sudo[101152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b
Jul 17 03:53:52 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:52 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-54d17c9e-b4f2-497b-b507-ba237539226b" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-54d17c9e-b4f2-497b-b507-ba237539226b" released by "delete_volume" :: held 0.622s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Created reservations ['09b3b3fd-bfbc-4b42-802b-263e07fd9110', 'c8e77b0f-ba95-441e-a54b-f534f0058bd2', 'ce503b4d-8ba1-4310-933b-f471117b980a', '3af60742-bb60-4cad-8488-c407d6e394cd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:53 devstack sudo[101155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:53 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:53 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Deleted volume successfully.
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5193a20a-ea87-449d-90d0-2a7938ac2c84 tempest-VolumesGetTest-689538618 None] Lock "cinder-54d17c9e-b4f2-497b-b507-ba237539226b-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-7980626d-0c90-4d3e-baa6-71ecd56b1fb0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Lock "cinder-7980626d-0c90-4d3e-baa6-71ecd56b1fb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-7980626d-0c90-4d3e-baa6-71ecd56b1fb0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-7980626d-0c90-4d3e-baa6-71ecd56b1fb0" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[414fb913-e780-4585-9dd8-4597af140b1b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:53 devstack sudo[101158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0
Jul 17 03:53:53 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:53 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:53 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0
Jul 17 03:53:53 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:54 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7980626d-0c90-4d3e-baa6-71ecd56b1fb0" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-7980626d-0c90-4d3e-baa6-71ecd56b1fb0" released by "delete_volume" :: held 0.622s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Created reservations ['53802a02-3afa-4c85-a110-395d31b982f8', '33b14fc9-f649-42a8-b0c3-f4a1eae0bb76', 'b043f183-bdbf-4889-8228-66a2fc04c4ba', 'd6d2f9d8-9ff7-4a4d-87bb-a858fa0f920f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:54 devstack sudo[101166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:53:54 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:54 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:53:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Deleted volume successfully.
Jul 17 03:53:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e137806c-6034-4d9d-ac0a-a73b5492dcfe tempest-VolumesGetTest-689538618 None] Lock "cinder-7980626d-0c90-4d3e-baa6-71ecd56b1fb0-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (0939a7fd-14b4-4a2a-a056-0f9351cfeccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61a744-6a77-4a88-97ac-5de114174cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e61a744-6a77-4a88-97ac-5de114174cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-553838629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7cb5b4-6913-4633-98ff-e52497cce047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:55Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e25843a-5ca5-494e-9cdc-fcc1a69701f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e25843a-5ca5-494e-9cdc-fcc1a69701f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff627d2-992e-4ce0-8f72-818296394160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff627d2-992e-4ce0-8f72-818296394160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf7cb5b4-6913-4633-98ff-e52497cce047', 'volume_name': 'volume-bf7cb5b4-6913-4633-98ff-e52497cce047', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2740f80-83c3-44b8-948e-5225d9f6f3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2740f80-83c3-44b8-948e-5225d9f6f3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ad9659-2105-42db-9d03-608dec859c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Volume bf7cb5b4-6913-4633-98ff-e52497cce047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf7cb5b4-6913-4633-98ff-e52497cce047', 'volume_size': 1}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-553838629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7cb5b4-6913-4633-98ff-e52497cce047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:55Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Creating volume bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:53:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:55 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 1073741824
Jul 17 03:53:55 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:55 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 1073741824" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:55 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047
Jul 17 03:53:55 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:55 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ad9659-2105-42db-9d03-608dec859c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7cb5b4-6913-4633-98ff-e52497cce047', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ba202f-e38d-4e42-b724-1729724e9318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Volume volume-bf7cb5b4-6913-4633-98ff-e52497cce047 (bf7cb5b4-6913-4633-98ff-e52497cce047): created successfully
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ba202f-e38d-4e42-b724-1729724e9318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (0939a7fd-14b4-4a2a-a056-0f9351cfeccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-49e63a7f-ee2c-4360-bab6-4ab065b5811d tempest-VolumesGetTest-689538618 None] Created volume successfully.
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (563742da-2e5b-46cc-8a6d-823e7d805402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a43717-c6c2-4e74-b8d8-046cf1a00a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a43717-c6c2-4e74-b8d8-046cf1a00a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1729177016',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680d80bb-6739-437d-85ac-5f298ac8bb76,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=bf7cb5b4-6913-4633-98ff-e52497cce047,status='creating',terminated_at=None,updated_at=2026-07-17T01:53:57Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d896f2-4dfb-4d38-8c25-7c38657e18da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d896f2-4dfb-4d38-8c25-7c38657e18da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dc21db-0c92-4211-b6aa-ec1b7baff1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7dc21db-0c92-4211-b6aa-ec1b7baff1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '680d80bb-6739-437d-85ac-5f298ac8bb76', 'volume_name': 'volume-680d80bb-6739-437d-85ac-5f298ac8bb76', 'volume_size': 1, 'source_volid': 'bf7cb5b4-6913-4633-98ff-e52497cce047', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cedd56-45a7-4c50-aaba-6d46df1da054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cedd56-45a7-4c50-aaba-6d46df1da054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b3ebba-9249-4e31-9ea2-adc092d388be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:53:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Volume 680d80bb-6739-437d-85ac-5f298ac8bb76: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-680d80bb-6739-437d-85ac-5f298ac8bb76', 'volume_size': 1, 'source_volid': 'bf7cb5b4-6913-4633-98ff-e52497cce047', 'source_volstatus': 'available'}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Cloning volume bf7cb5b4-6913-4633-98ff-e52497cce047 to volume 680d80bb-6739-437d-85ac-5f298ac8bb76
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Creating offline snapshot 582b28f4-59ff-43e8-af5c-645668187dd0 of volume bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f406ad-4a16-44b8-a8c5-e916e41c0f90]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:56 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047
Jul 17 03:53:56 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:57 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:57 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 1G
Jul 17 03:53:57 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:57 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 1G" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7cb5b4-6913-4633-98ff-e52497cce047 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:57 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7cb5b4-6913-4633-98ff-e52497cce047 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0
Jul 17 03:53:57 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:57 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf7cb5b4-6913-4633-98ff-e52497cce047 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:57 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 is being set with open permissions: ugo+rw
Jul 17 03:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:57 devstack sudo[101193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0
Jul 17 03:53:57 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:57 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:58 devstack sudo[101196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.info
Jul 17 03:53:58 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:58 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.info" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:58 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.info is being set with open permissions: ugo+rw
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:58 devstack sudo[101199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.info
Jul 17 03:53:58 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:58 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.info" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-680d80bb-6739-437d-85ac-5f298ac8bb76" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-680d80bb-6739-437d-85ac-5f298ac8bb76" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] snapshot: 582b28f4-59ff-43e8-af5c-645668187dd0, volume: 680d80bb-6739-437d-85ac-5f298ac8bb76,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c86b9e-3bf0-471d-abba-58fabf291e99]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:58 devstack sudo[101202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0
Jul 17 03:53:58 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:58 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf7cb5b4-6913-4633-98ff-e52497cce047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a1588d-29dc-4d2a-9514-3925a739fe09]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:59 devstack sudo[101207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047
Jul 17 03:53:59 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:53:59 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root
Jul 17 03:53:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:53:59 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:53:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:53:59 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76
Jul 17 03:53:59 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:03 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76" returned: 0 in 4.011s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30c804-a0c9-4478-a98b-a8ef40f254c4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:03 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047
Jul 17 03:54:03 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:03 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:03 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:54:03 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Converted 1024.00 MB image at 255.22 MB/s
Jul 17 03:54:03 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76 is being set with open permissions: ugo+rw
Jul 17 03:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:03 devstack sudo[101231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76
Jul 17 03:54:03 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:04 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-680d80bb-6739-437d-85ac-5f298ac8bb76" released by "_copy_volume_from_snapshot" :: held 5.542s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-582b28f4-59ff-43e8-af5c-645668187dd0" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-582b28f4-59ff-43e8-af5c-645668187dd0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Deleting offline snapshot 582b28f4-59ff-43e8-af5c-645668187dd0 of volume bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] snapshot_file for this snap is: volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afaa4e5-c48b-499c-9477-8a559c8382b6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:04 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0
Jul 17 03:54:04 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:04 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf7cb5b4-6913-4633-98ff-e52497cce047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755e6ec-8fa8-449d-8ac4-4b65ee3c483a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:04 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047
Jul 17 03:54:04 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:04 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:04 devstack sudo[101246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0
Jul 17 03:54:04 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:05 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:05 devstack sudo[101252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0
Jul 17 03:54:05 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:05 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047.582b28f4-59ff-43e8-af5c-645668187dd0" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-582b28f4-59ff-43e8-af5c-645668187dd0" released by "_delete_snapshot" :: held 1.351s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.808s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b3ebba-9249-4e31-9ea2-adc092d388be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680d80bb-6739-437d-85ac-5f298ac8bb76', 'volume_size': 1, 'source_volid': 'bf7cb5b4-6913-4633-98ff-e52497cce047', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42f799a-4c91-45cb-9fdd-0ee3ac9bf6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Volume volume-680d80bb-6739-437d-85ac-5f298ac8bb76 (680d80bb-6739-437d-85ac-5f298ac8bb76): created successfully
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42f799a-4c91-45cb-9fdd-0ee3ac9bf6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (563742da-2e5b-46cc-8a6d-823e7d805402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aa314457-7238-4f56-84dc-70d092cc2a61 tempest-VolumesGetTest-689538618 None] Created volume successfully.
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (2f720a6b-7b37-4d0f-bfb4-b3829da46f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80b3c01-88ff-4dc0-969f-ef1c32a65fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80b3c01-88ff-4dc0-969f-ef1c32a65fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-844038775',display_name='tempest-VolumesGetTest-Volume-1961565855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608ad8ae-1d47-424b-9d0b-94ae2f269eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:07Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f963108-95d3-45c9-9b9c-61db1679284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f963108-95d3-45c9-9b9c-61db1679284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2b7c00-e3b5-4e7f-a205-c9281f7c4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2b7c00-e3b5-4e7f-a205-c9281f7c4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608ad8ae-1d47-424b-9d0b-94ae2f269eb4', 'volume_name': 'volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c46099-d5f8-445d-a5a6-3720529397cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27c46099-d5f8-445d-a5a6-3720529397cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0c013e-e7de-4b4e-949a-17244361b211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Volume 608ad8ae-1d47-424b-9d0b-94ae2f269eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4', 'volume_size': 1}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-844038775',display_name='tempest-VolumesGetTest-Volume-1961565855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608ad8ae-1d47-424b-9d0b-94ae2f269eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:07Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Creating volume 608ad8ae-1d47-424b-9d0b-94ae2f269eb4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:54:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:07 devstack sudo[101256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4 1073741824
Jul 17 03:54:07 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:07 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4 1073741824" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:07 devstack sudo[101261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4
Jul 17 03:54:07 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:07 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0c013e-e7de-4b4e-949a-17244361b211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cef498c-eb46-46d6-abf9-d253f83e965d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Volume volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4 (608ad8ae-1d47-424b-9d0b-94ae2f269eb4): created successfully
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cef498c-eb46-46d6-abf9-d253f83e965d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (2f720a6b-7b37-4d0f-bfb4-b3829da46f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b07cff30-85c2-4659-9c8e-495c8e8eda2e tempest-VolumesGetTest-689538618 None] Created volume successfully.
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-608ad8ae-1d47-424b-9d0b-94ae2f269eb4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Lock "cinder-608ad8ae-1d47-424b-9d0b-94ae2f269eb4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-608ad8ae-1d47-424b-9d0b-94ae2f269eb4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-608ad8ae-1d47-424b-9d0b-94ae2f269eb4" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5773aa6a-1e2a-4eec-bda2-0b531a629d68]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:08 devstack sudo[101264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4
Jul 17 03:54:08 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:08 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:08 devstack sudo[101269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4
Jul 17 03:54:08 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:08 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-608ad8ae-1d47-424b-9d0b-94ae2f269eb4" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-608ad8ae-1d47-424b-9d0b-94ae2f269eb4" released by "delete_volume" :: held 0.629s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Created reservations ['82ae16aa-c362-4527-ab17-c4bda1ad6539', '5d0c79c7-9762-4e5f-845b-ffe8afd4d1b6', 'ce2dc56f-db79-4364-9dfc-ad34368b495e', '2a770703-3a43-4ed8-8757-5df477c73bfc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:08 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:08 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:09 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Deleted volume successfully.
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a20285db-e7b1-4219-b4bc-4f496f37eb87 tempest-VolumesGetTest-689538618 None] Lock "cinder-608ad8ae-1d47-424b-9d0b-94ae2f269eb4-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-680d80bb-6739-437d-85ac-5f298ac8bb76-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Lock "cinder-680d80bb-6739-437d-85ac-5f298ac8bb76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-680d80bb-6739-437d-85ac-5f298ac8bb76" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-680d80bb-6739-437d-85ac-5f298ac8bb76" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9092c5-f9c5-4cce-b7ec-616e840e034b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:09 devstack sudo[101275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76
Jul 17 03:54:09 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:09 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:09 devstack sudo[101280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76
Jul 17 03:54:09 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:09 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-680d80bb-6739-437d-85ac-5f298ac8bb76" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-680d80bb-6739-437d-85ac-5f298ac8bb76" released by "delete_volume" :: held 0.626s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Created reservations ['893de4b7-4990-46e1-8b03-8b801aa842cd', '6aa3330e-e849-41d5-bbf9-70ddfa3edc13', '912b2666-c680-4586-8ddc-fc6e57896b86', '6371924b-4a16-444f-8ab9-af28d589aa6e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:10 devstack sudo[101283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:10 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:10 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Deleted volume successfully.
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b8415d56-17cb-4f15-95e4-7865d853db3b tempest-VolumesGetTest-689538618 None] Lock "cinder-680d80bb-6739-437d-85ac-5f298ac8bb76-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-bf7cb5b4-6913-4633-98ff-e52497cce047-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Lock "cinder-bf7cb5b4-6913-4633-98ff-e52497cce047-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-bf7cb5b4-6913-4633-98ff-e52497cce047" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-bf7cb5b4-6913-4633-98ff-e52497cce047" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[28772246-0960-49be-ad17-2a88c3fc687f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:10 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047
Jul 17 03:54:10 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:10 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:10 devstack sudo[101291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047
Jul 17 03:54:10 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:11 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-bf7cb5b4-6913-4633-98ff-e52497cce047" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-bf7cb5b4-6913-4633-98ff-e52497cce047" released by "delete_volume" :: held 0.646s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Created reservations ['8c4ee761-cf20-49ad-9099-7fe2b671eb4b', '24a5dca9-c841-4ed1-a9fe-c433db0e4f57', 'a2b8b19e-8238-4fb7-9d85-695beb26e08b', 'f19dfb42-6d45-4675-8801-6f5d52f83274'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:11 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:11 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:11 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Deleted volume successfully.
Jul 17 03:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eccba9e6-87c8-44e2-888c-0fa2140668db tempest-VolumesGetTest-689538618 None] Lock "cinder-bf7cb5b4-6913-4633-98ff-e52497cce047-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:12 devstack sudo[101297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:12 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (79ad79cb-9fd0-42a2-bb7a-1937d577e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab737103-20e2-417f-b9ae-5e5cecaf2299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab737103-20e2-417f-b9ae-5e5cecaf2299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1862026069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910462cc-d4b7-4fb2-84ae-7cb86e76eb5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:12Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c25bef-3da7-470b-a754-018f7b2b674a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c25bef-3da7-470b-a754-018f7b2b674a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866a5260-f0b3-4973-b37f-a9729b38d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 03:54:12 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (866a5260-f0b3-4973-b37f-a9729b38d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '910462cc-d4b7-4fb2-84ae-7cb86e76eb5f', 'volume_name': 'volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cfd23f0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04dd54be-92e0-4984-b64c-ba9aec049496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04dd54be-92e0-4984-b64c-ba9aec049496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d460d1c8-65f3-47a2-8b04-bbf8a99ee045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Volume 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cfd23f0>}
Jul 17 03:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Trying to clone 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 at location (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 03:54:13 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Image download 20.69 MB at 20.69 MB/s
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b5a2ec-da2f-43cc-96e2-1d6c6780eade]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:13 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD
Jul 17 03:54:13 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:13 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 is fetched for user 5544d8bf518544e4a6221e6759b683e8. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f461f-d5ce-4b64-b385-964da46103b1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:13 devstack sudo[101306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD
Jul 17 03:54:13 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:13 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1862026069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910462cc-d4b7-4fb2-84ae-7cb86e76eb5f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:12Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Creating volume 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:54:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:13 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f 1073741824
Jul 17 03:54:13 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:14 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f 1073741824" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:14 devstack sudo[101316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f
Jul 17 03:54:14 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:14 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Attempting download of 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[639ff903-583c-46ab-bc68-51f4f2fa5bba]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_hmryzia8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:14 devstack sudo[101319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_hmryzia8
Jul 17 03:54:14 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:14 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_hmryzia8" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_hmryzia8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:14 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_hmryzia8
Jul 17 03:54:14 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:15 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_hmryzia8" returned: 1 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_hmryzia8' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:54:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be02595-f2c8-47fe-a4d6-3b1d688ad912]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:15 devstack sudo[101327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD
Jul 17 03:54:15 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:15 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:15 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 03:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:15 devstack sudo[101332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f
Jul 17 03:54:15 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:17 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f" returned: 0 in 1.517s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_594fe0bf-aa5d-4b12-bb87-5e3d6afaa320_bxey3yaxdevstack@QuobyteHD, size 112.00 MB, duration 1.52 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:54:17 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Converted 112.00 MB image at 73.75 MB/s
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:17 devstack sudo[101342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f 1G
Jul 17 03:54:17 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:17 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f 1G" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Downloaded image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 ((None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}])) to volume 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Temporary image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 for user 5544d8bf518544e4a6221e6759b683e8 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Marking volume 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Copying metadata from image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 to 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Creating volume glance metadata for volume 910462cc-d4b7-4fb2-84ae-7cb86e76eb5f backed by image 594fe0bf-aa5d-4b12-bb87-5e3d6afaa320 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d460d1c8-65f3-47a2-8b04-bbf8a99ee045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f', 'volume_size': 1, 'image_id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e3ac75d58e6f4e85ab4198d89d708829', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '594fe0bf-aa5d-4b12-bb87-5e3d6afaa320', 'created_at': datetime.datetime(2026, 7, 17, 1, 33, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 33, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/594fe0bf-aa5d-4b12-bb87-5e3d6afaa320/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cfd23f0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0875e0-b094-485e-ae5f-b567c75c49b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Volume volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f (910462cc-d4b7-4fb2-84ae-7cb86e76eb5f): created successfully
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0875e0-b094-485e-ae5f-b567c75c49b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (79ad79cb-9fd0-42a2-bb7a-1937d577e450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cdbaf655-895b-44f5-8620-90fb4b6a6658 tempest-VolumesGetTest-689538618 None] Created volume successfully.
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (4b4bcdf1-4686-4114-85eb-dc8f8bbbb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dc5b4f-8dd8-4005-ab93-68751bd6cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7dc5b4f-8dd8-4005-ab93-68751bd6cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-914622296',display_name='tempest-VolumesGetTest-Volume-522923341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642e7065-7a94-4ab6-a3da-7b3f0e537e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:18Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13547b92-c531-4f1c-987f-a6ed839c5616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13547b92-c531-4f1c-987f-a6ed839c5616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa835d3-203a-4146-b4bc-496d20ed7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa835d3-203a-4146-b4bc-496d20ed7864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642e7065-7a94-4ab6-a3da-7b3f0e537e9b', 'volume_name': 'volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd7acb8-7242-4ce7-9b98-2104b59f96c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd7acb8-7242-4ce7-9b98-2104b59f96c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb10c611-577a-4c9e-b2d6-7993f4ddc5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Volume 642e7065-7a94-4ab6-a3da-7b3f0e537e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b', 'volume_size': 1}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-914622296',display_name='tempest-VolumesGetTest-Volume-522923341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642e7065-7a94-4ab6-a3da-7b3f0e537e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c06d88e3976d427c8280bb52544db6e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:18Z,use_quota=True,user_id='5544d8bf518544e4a6221e6759b683e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Creating volume 642e7065-7a94-4ab6-a3da-7b3f0e537e9b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:54:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:18 devstack sudo[101347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b 1073741824
Jul 17 03:54:18 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:18 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b 1073741824" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:18 devstack sudo[101353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b
Jul 17 03:54:18 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:19 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb10c611-577a-4c9e-b2d6-7993f4ddc5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a486dbac-ef34-47e5-a7c0-d6375cc7b599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Volume volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b (642e7065-7a94-4ab6-a3da-7b3f0e537e9b): created successfully
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a486dbac-ef34-47e5-a7c0-d6375cc7b599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Flow 'volume_create_manager' (4b4bcdf1-4686-4114-85eb-dc8f8bbbb755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b568c318-0269-484f-a597-9090e0b564a8 tempest-VolumesGetTest-689538618 None] Created volume successfully.
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-642e7065-7a94-4ab6-a3da-7b3f0e537e9b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Lock "cinder-642e7065-7a94-4ab6-a3da-7b3f0e537e9b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-642e7065-7a94-4ab6-a3da-7b3f0e537e9b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-642e7065-7a94-4ab6-a3da-7b3f0e537e9b" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc42cf9-aa6b-4984-9114-a30b2e8b0925]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:19 devstack sudo[101356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b
Jul 17 03:54:19 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:19 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:19 devstack sudo[101361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b
Jul 17 03:54:19 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:20 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-642e7065-7a94-4ab6-a3da-7b3f0e537e9b" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-642e7065-7a94-4ab6-a3da-7b3f0e537e9b" released by "delete_volume" :: held 0.620s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Created reservations ['5f547592-b8e8-452e-a138-512c66201d75', 'e584541f-caa4-41a6-a1bd-63ea2650f3e8', '76041f63-1ed6-420c-81f4-775a389f4dd0', 'd1e6fece-d3d5-47db-a704-6a7c834a3198'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:20 devstack sudo[101364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:20 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:20 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Deleted volume successfully.
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6cdbb55b-668a-4fe7-ac1a-9c3f94a9ea28 tempest-VolumesGetTest-689538618 None] Lock "cinder-642e7065-7a94-4ab6-a3da-7b3f0e537e9b-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Lock "cinder-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Acquiring lock "cinder-quobyte-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f825e-dda8-4b01-8145-1c678b8f5845]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:20 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f
Jul 17 03:54:20 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:21 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:21 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f
Jul 17 03:54:21 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:21 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Lock "cinder-quobyte-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f" released by "delete_volume" :: held 0.636s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Created reservations ['53596fc7-cd78-4067-a930-bae759983111', 'd71d5bec-d818-4c00-89f9-36983533fbfe', '42943daf-c1a3-4a55-8634-0748da6849c4', 'a4c1e81f-7b52-4f97-b0c9-c1c5c35608f1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:21 devstack sudo[101375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:21 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:21 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Deleted volume successfully.
Jul 17 03:54:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3070194-aed2-4c0a-b4e8-57be17a8df8b tempest-VolumesGetTest-689538618 None] Lock "cinder-910462cc-d4b7-4fb2-84ae-7cb86e76eb5f-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Flow 'volume_create_manager' (4a4f3200-0d33-48ba-b1c6-8b0bc2de4493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d6a8ed-fad2-4f1d-8aea-1970f3db143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06d6a8ed-fad2-4f1d-8aea-1970f3db143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-214711726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d324330-f296-4725-887e-d6a2583c162b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbf3d41e6624b81b002f3f7e376089b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:24Z,use_quota=True,user_id='3690c6abb5194aab91711337e270fc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fff79e-e056-4e93-a8cc-559bd3f7c62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fff79e-e056-4e93-a8cc-559bd3f7c62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadbd43b-b04b-4b76-8f64-3508f64564eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadbd43b-b04b-4b76-8f64-3508f64564eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d324330-f296-4725-887e-d6a2583c162b', 'volume_name': 'volume-4d324330-f296-4725-887e-d6a2583c162b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e54a00f-a4de-4c24-a456-c102d2cf5203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e54a00f-a4de-4c24-a456-c102d2cf5203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2793d239-d759-4387-93d3-c76da4df39a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Volume 4d324330-f296-4725-887e-d6a2583c162b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d324330-f296-4725-887e-d6a2583c162b', 'volume_size': 1}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-214711726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d324330-f296-4725-887e-d6a2583c162b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbf3d41e6624b81b002f3f7e376089b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:24Z,use_quota=True,user_id='3690c6abb5194aab91711337e270fc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Creating volume 4d324330-f296-4725-887e-d6a2583c162b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:54:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:24 devstack sudo[101379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b 1073741824
Jul 17 03:54:24 devstack sudo[101379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:24 devstack sudo[101379]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b 1073741824" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:24 devstack sudo[101384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b
Jul 17 03:54:24 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:25 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2793d239-d759-4387-93d3-c76da4df39a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d324330-f296-4725-887e-d6a2583c162b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aff65d-18fb-4c35-b957-4c4498d9acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Volume volume-4d324330-f296-4725-887e-d6a2583c162b (4d324330-f296-4725-887e-d6a2583c162b): created successfully
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3aff65d-18fb-4c35-b957-4c4498d9acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Flow 'volume_create_manager' (4a4f3200-0d33-48ba-b1c6-8b0bc2de4493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1ef76bfc-f680-4e7b-b39f-b53953998ff3 tempest-VolumesListTestJSON-1565122525 None] Created volume successfully.
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Flow 'volume_create_manager' (d472016b-6d46-447d-93d8-bda1cf5d89a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2b3a9d-f96b-446b-9c20-4b494e271a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f2b3a9d-f96b-446b-9c20-4b494e271a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1254245379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54ce5fb-e89b-4bd6-9bae-c78df864674d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbf3d41e6624b81b002f3f7e376089b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:26Z,use_quota=True,user_id='3690c6abb5194aab91711337e270fc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ecc59e-9096-4f04-8819-0ff405a4dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ecc59e-9096-4f04-8819-0ff405a4dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b581ef3-84d3-4391-814b-fa900c7875fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b581ef3-84d3-4391-814b-fa900c7875fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54ce5fb-e89b-4bd6-9bae-c78df864674d', 'volume_name': 'volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd19f601-2121-4773-9cfc-19a12235c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd19f601-2121-4773-9cfc-19a12235c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6380ac-11a9-458b-b97b-e0f66d8075a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Volume c54ce5fb-e89b-4bd6-9bae-c78df864674d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d', 'volume_size': 1}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1254245379',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54ce5fb-e89b-4bd6-9bae-c78df864674d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbf3d41e6624b81b002f3f7e376089b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:26Z,use_quota=True,user_id='3690c6abb5194aab91711337e270fc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Creating volume c54ce5fb-e89b-4bd6-9bae-c78df864674d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:54:25 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:25 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d 1073741824
Jul 17 03:54:25 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:26 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d 1073741824" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:26 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d
Jul 17 03:54:26 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:26 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6380ac-11a9-458b-b97b-e0f66d8075a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1994b7a8-ba51-406b-9b83-f08dfaec7ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Volume volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d (c54ce5fb-e89b-4bd6-9bae-c78df864674d): created successfully
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1994b7a8-ba51-406b-9b83-f08dfaec7ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Flow 'volume_create_manager' (d472016b-6d46-447d-93d8-bda1cf5d89a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-214f3e4f-e2c6-49ea-862f-ae91c5f396a2 tempest-VolumesListTestJSON-1565122525 None] Created volume successfully.
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Flow 'volume_create_manager' (7017af27-5f85-4005-a79b-f9c39043b745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb276784-6a74-4b68-8807-7dde8022e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb276784-6a74-4b68-8807-7dde8022e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-345748736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0d981b-012e-40c8-ba6a-fb147eb2c845,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbf3d41e6624b81b002f3f7e376089b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:27Z,use_quota=True,user_id='3690c6abb5194aab91711337e270fc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d427f38-7b49-4dee-aff7-5c6cc06447fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d427f38-7b49-4dee-aff7-5c6cc06447fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d71aeb5-e25f-4520-9ec3-442e335ff34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d71aeb5-e25f-4520-9ec3-442e335ff34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0d981b-012e-40c8-ba6a-fb147eb2c845', 'volume_name': 'volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4696016-3917-4ca8-b6b7-7ad7af949c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4696016-3917-4ca8-b6b7-7ad7af949c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c578f00d-f9e4-4d98-bf2b-fe2b9a4b284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Volume 9d0d981b-012e-40c8-ba6a-fb147eb2c845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845', 'volume_size': 1}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-345748736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0d981b-012e-40c8-ba6a-fb147eb2c845,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4fbf3d41e6624b81b002f3f7e376089b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:27Z,use_quota=True,user_id='3690c6abb5194aab91711337e270fc0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Creating volume 9d0d981b-012e-40c8-ba6a-fb147eb2c845 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:54:27 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:27 devstack sudo[101396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845 1073741824
Jul 17 03:54:27 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:27 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845 1073741824" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:27 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845
Jul 17 03:54:27 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:28 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:54:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c578f00d-f9e4-4d98-bf2b-fe2b9a4b284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6897032-7160-4fa1-9e6a-8fc9f5f826cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Volume volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845 (9d0d981b-012e-40c8-ba6a-fb147eb2c845): created successfully
Jul 17 03:54:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6897032-7160-4fa1-9e6a-8fc9f5f826cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Flow 'volume_create_manager' (7017af27-5f85-4005-a79b-f9c39043b745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-51179485-8fd1-41a9-8db7-9c27aebef251 tempest-VolumesListTestJSON-1565122525 None] Created volume successfully.
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "cinder-9d0d981b-012e-40c8-ba6a-fb147eb2c845-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-9d0d981b-012e-40c8-ba6a-fb147eb2c845-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "cinder-quobyte-9d0d981b-012e-40c8-ba6a-fb147eb2c845" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-quobyte-9d0d981b-012e-40c8-ba6a-fb147eb2c845" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7afb5bc-93ac-449a-a9d5-a8c3cca40365]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:30 devstack sudo[101405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845
Jul 17 03:54:30 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:30 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:30 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845
Jul 17 03:54:30 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:30 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d0d981b-012e-40c8-ba6a-fb147eb2c845" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-quobyte-9d0d981b-012e-40c8-ba6a-fb147eb2c845" released by "delete_volume" :: held 0.616s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Created reservations ['e587be6c-17bc-4314-8c51-3b61fa4b2424', '08cf4ffc-5c62-4738-8d6c-e410373a3249', '211b1627-7563-43eb-bc48-2164142d2cdd', '745f62aa-ab6b-48e1-acb4-c3a7b1caa856'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:31 devstack sudo[101413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:31 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:31 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Deleted volume successfully.
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a333a32-3263-4ae9-b314-dbc65ac91f89 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-9d0d981b-012e-40c8-ba6a-fb147eb2c845-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "cinder-c54ce5fb-e89b-4bd6-9bae-c78df864674d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-c54ce5fb-e89b-4bd6-9bae-c78df864674d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "cinder-quobyte-c54ce5fb-e89b-4bd6-9bae-c78df864674d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-quobyte-c54ce5fb-e89b-4bd6-9bae-c78df864674d" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7684e40-b9ac-4951-b9cc-5173591cb4c3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:31 devstack sudo[101416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d
Jul 17 03:54:31 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:31 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:31 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d
Jul 17 03:54:31 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:32 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c54ce5fb-e89b-4bd6-9bae-c78df864674d" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-quobyte-c54ce5fb-e89b-4bd6-9bae-c78df864674d" released by "delete_volume" :: held 0.617s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Created reservations ['213300ce-7305-4bcc-8215-76e932802790', '3b71bc9d-f03e-47f6-9a8f-bea4f2cdd139', '86bf23d7-468f-4689-9e22-656953254334', '38ecce0b-15e9-4ea2-8eff-1b64a57c49c7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:32 devstack sudo[101424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:32 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:32 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Deleted volume successfully.
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-555f7c8f-5b74-41dc-9c7d-816f13871d42 tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-c54ce5fb-e89b-4bd6-9bae-c78df864674d-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "cinder-4d324330-f296-4725-887e-d6a2583c162b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-4d324330-f296-4725-887e-d6a2583c162b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "cinder-quobyte-4d324330-f296-4725-887e-d6a2583c162b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-quobyte-4d324330-f296-4725-887e-d6a2583c162b" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[964bb971-d2ab-4a0e-b3b3-1786c923a0f3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:32 devstack sudo[101427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b
Jul 17 03:54:32 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:33 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:33 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b
Jul 17 03:54:33 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:33 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-4d324330-f296-4725-887e-d6a2583c162b" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-quobyte-4d324330-f296-4725-887e-d6a2583c162b" released by "delete_volume" :: held 0.625s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Created reservations ['32fb60d9-d1eb-4fec-a086-ccb41eb93d5d', '4bc8f0aa-61cd-4608-85ed-949137cb29fd', 'dade457f-eb47-4aec-8b61-f4b4ef794033', '8ff6002b-1025-4225-a075-e1247e43a45c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:33 devstack sudo[101435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:33 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:33 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Deleted volume successfully.
Jul 17 03:54:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b849b4e6-54fd-4c5b-9547-959bce180d3f tempest-VolumesListTestJSON-1565122525 None] Lock "cinder-4d324330-f296-4725-887e-d6a2583c162b-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=147,cinder:INSERT=41,cinder:SELECT=102,cinder:DELETE=16 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=103,cinder:UPDATE=146,cinder:DELETE=10,cinder:INSERT=39 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Flow 'volume_create_manager' (a54161be-319a-47e2-bd6a-9e1c74a1527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fb3f3-b32e-4650-b89a-a0c4bf9d912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fb3f3-b32e-4650-b89a-a0c4bf9d912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-822970178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b55303-8e75-4c16-8bd2-c44430ad9168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c73dd16e2bb41a2868de0f8aaecc0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:36Z,use_quota=True,user_id='59fe8a8038604bdea379aadfadaf977a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255cc750-8332-4666-a3f0-266407be9ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255cc750-8332-4666-a3f0-266407be9ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4c3415-873d-417e-ad59-865a09089de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4c3415-873d-417e-ad59-865a09089de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b55303-8e75-4c16-8bd2-c44430ad9168', 'volume_name': 'volume-27b55303-8e75-4c16-8bd2-c44430ad9168', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b1b1f8-d486-4378-91df-d2cadd5e7846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b1b1f8-d486-4378-91df-d2cadd5e7846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5949c257-eff0-48c4-9603-6756dd7c219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Volume 27b55303-8e75-4c16-8bd2-c44430ad9168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b55303-8e75-4c16-8bd2-c44430ad9168', 'volume_size': 2}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-822970178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b55303-8e75-4c16-8bd2-c44430ad9168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c73dd16e2bb41a2868de0f8aaecc0c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:54:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:54:36Z,use_quota=True,user_id='59fe8a8038604bdea379aadfadaf977a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Creating volume 27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:54:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 2147483648 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:36 devstack sudo[101439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 2147483648
Jul 17 03:54:36 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:37 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 2147483648" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:37 devstack sudo[101445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168
Jul 17 03:54:37 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:37 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5949c257-eff0-48c4-9603-6756dd7c219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b55303-8e75-4c16-8bd2-c44430ad9168', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7592c2-2504-408a-a94a-40977b0d3188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:54:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Volume volume-27b55303-8e75-4c16-8bd2-c44430ad9168 (27b55303-8e75-4c16-8bd2-c44430ad9168): created successfully
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7592c2-2504-408a-a94a-40977b0d3188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Flow 'volume_create_manager' (a54161be-319a-47e2-bd6a-9e1c74a1527b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:54:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8279ee4b-d377-42ab-81b3-eddd70bd00d5 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Created volume successfully.
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Creating offline snapshot 7f469c24-0ac6-4524-ab4a-50b774776579 of volume 27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a620e8-721c-4711-aefb-7a14f613d8a7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:37 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168
Jul 17 03:54:37 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:38 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:38 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 2G
Jul 17 03:54:38 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:38 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 2G" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b55303-8e75-4c16-8bd2-c44430ad9168 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:38 devstack sudo[101495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b55303-8e75-4c16-8bd2-c44430ad9168 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579
Jul 17 03:54:38 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:38 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27b55303-8e75-4c16-8bd2-c44430ad9168 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 is being set with open permissions: ugo+rw
Jul 17 03:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:38 devstack sudo[101500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579
Jul 17 03:54:38 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:38 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:39 devstack sudo[101503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.info
Jul 17 03:54:39 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:39 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.info" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:39 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.info is being set with open permissions: ugo+rw
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:39 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.info
Jul 17 03:54:39 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:39 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.info" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1821dcfc-ccbb-4479-894f-71e773164a04 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Create snapshot completed successfully
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "cinder-7f469c24-0ac6-4524-ab4a-50b774776579-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-7f469c24-0ac6-4524-ab4a-50b774776579-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "cinder-quobyte-27b55303-8e75-4c16-8bd2-c44430ad9168" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-quobyte-27b55303-8e75-4c16-8bd2-c44430ad9168" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "cinder-quobyte-7f469c24-0ac6-4524-ab4a-50b774776579" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-quobyte-7f469c24-0ac6-4524-ab4a-50b774776579" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Deleting offline snapshot 7f469c24-0ac6-4524-ab4a-50b774776579 of volume 27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] snapshot_file for this snap is: volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee10e1b-169f-4a46-b8cf-d695dd7a5be4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:40 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579
Jul 17 03:54:40 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:40 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27b55303-8e75-4c16-8bd2-c44430ad9168(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:54:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b0979-58e1-48ee-94a9-13d58aa106a4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:40 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168
Jul 17 03:54:40 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:40 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:40 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579
Jul 17 03:54:40 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:41 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:41 devstack sudo[101524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579
Jul 17 03:54:41 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:41 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168.7f469c24-0ac6-4524-ab4a-50b774776579" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-quobyte-7f469c24-0ac6-4524-ab4a-50b774776579" released by "_delete_snapshot" :: held 1.362s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-quobyte-27b55303-8e75-4c16-8bd2-c44430ad9168" released by "delete_snapshot" :: held 1.382s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Created reservations ['d7bef646-333d-4016-b37a-ce3cdbad29e0', '4c705615-49f2-4a21-9297-a9a84db0f478', '2caa0652-3180-4395-8579-9812cd05cefa', 'ad98a4bc-9213-4e7a-9278-5775c8fde971'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Delete snapshot completed successfully.
Jul 17 03:54:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f127e885-13bf-4220-8bda-38b5b0e9b69c tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-7f469c24-0ac6-4524-ab4a-50b774776579-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "cinder-27b55303-8e75-4c16-8bd2-c44430ad9168-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-27b55303-8e75-4c16-8bd2-c44430ad9168-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "cinder-quobyte-27b55303-8e75-4c16-8bd2-c44430ad9168" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-quobyte-27b55303-8e75-4c16-8bd2-c44430ad9168" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6282ee-cc1b-4adc-8ac4-f9d49245bc68]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:42 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168
Jul 17 03:54:42 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:42 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:42 devstack sudo[101532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168
Jul 17 03:54:42 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:42 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-27b55303-8e75-4c16-8bd2-c44430ad9168" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-quobyte-27b55303-8e75-4c16-8bd2-c44430ad9168" released by "delete_volume" :: held 0.651s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Created reservations ['ccfb1212-4969-4d91-a64d-d535fa46ceb9', '97a5da1a-79cf-40d4-a6a7-672d6b4c7b71', 'aba0b825-f2d6-43d9-b0b6-79f6fa2cc5ce', '35a3df3e-faa8-4d4c-9fe3-d6d24f377d01'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:54:42 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:54:42 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:54:43 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Jul 17 03:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:54:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:54:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Deleted volume successfully.
Jul 17 03:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-533febf2-27ed-467d-8635-928e23adfa68 tempest-VolumesSnapshotNegativeTestJSON-1465778563 None] Lock "cinder-27b55303-8e75-4c16-8bd2-c44430ad9168-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:54:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=14,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:54:53 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=17,cinder:UPDATE=17,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:55:12 devstack sudo[102048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:55:12 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:55:12 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:55:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Flow 'volume_create_manager' (9d2ebf76-9037-4f69-87e5-b5db6c6381a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8084866-764d-457b-9c57-7b7c379617a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8084866-764d-457b-9c57-7b7c379617a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-550624444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3927ec-4405-4d7e-892d-75e4e9ae6e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5c54f6494445dea5397c24a41a4da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:55:16Z,use_quota=True,user_id='ca14bf3b36a6426fb4328b511ea2f5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fabab30-ff68-491e-9efa-28856d61a4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fabab30-ff68-491e-9efa-28856d61a4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b51111-825f-4601-b6c4-27cccde1b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b51111-825f-4601-b6c4-27cccde1b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3927ec-4405-4d7e-892d-75e4e9ae6e51', 'volume_name': 'volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7842f72-7034-42dd-98f0-5974f5ae423b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7842f72-7034-42dd-98f0-5974f5ae423b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50fb194-9cae-4002-ab9d-074509e4ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:55:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Volume 3e3927ec-4405-4d7e-892d-75e4e9ae6e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51', 'volume_size': 1}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-550624444',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3927ec-4405-4d7e-892d-75e4e9ae6e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de5c54f6494445dea5397c24a41a4da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:55:16Z,use_quota=True,user_id='ca14bf3b36a6426fb4328b511ea2f5da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Creating volume 3e3927ec-4405-4d7e-892d-75e4e9ae6e51 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:55:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:55:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:55:15 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51 1073741824
Jul 17 03:55:15 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:55:16 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51 1073741824" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:55:16 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51
Jul 17 03:55:16 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:55:16 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b50fb194-9cae-4002-ab9d-074509e4ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a08bb8-2126-4ff9-b376-355e0e2a95a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:55:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Volume volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51 (3e3927ec-4405-4d7e-892d-75e4e9ae6e51): created successfully
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a08bb8-2126-4ff9-b376-355e0e2a95a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:55:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Flow 'volume_create_manager' (9d2ebf76-9037-4f69-87e5-b5db6c6381a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:55:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e32aa2b5-5aed-47a6-b0f2-2265105017f0 tempest-TestMinimumBasicScenario-583098845 None] Created volume successfully.
Jul 17 03:55:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1ccd5249-8f2c-4a95-8127-98e219152f3b req-84d3c9b9-3655-4c70-8ee6-87bcc0eb326a tempest-TestMinimumBasicScenario-583098845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:55:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1ccd5249-8f2c-4a95-8127-98e219152f3b req-84d3c9b9-3655-4c70-8ee6-87bcc0eb326a tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:55:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-1ccd5249-8f2c-4a95-8127-98e219152f3b req-84d3c9b9-3655-4c70-8ee6-87bcc0eb326a tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:55:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-1ccd5249-8f2c-4a95-8127-98e219152f3b req-84d3c9b9-3655-4c70-8ee6-87bcc0eb326a tempest-TestMinimumBasicScenario-583098845 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c3a71db-3a82-4a8d-af42-2922242ed8b4', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:55:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-1ccd5249-8f2c-4a95-8127-98e219152f3b req-84d3c9b9-3655-4c70-8ee6-87bcc0eb326a tempest-TestMinimumBasicScenario-583098845 None] attachment_update completed successfully.
Jul 17 03:55:27 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:55:27 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=5,cinder:SELECT=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:56:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-d81229f0-9ae4-43ba-8362-b39a434f4542 req-74e46c9a-819d-44a2-b2cc-a322ec053dd7 tempest-TestMinimumBasicScenario-583098845 None] Terminate volume connection completed successfully.
Jul 17 03:56:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d81229f0-9ae4-43ba-8362-b39a434f4542 req-74e46c9a-819d-44a2-b2cc-a322ec053dd7 tempest-TestMinimumBasicScenario-583098845 None] Deleting attachment 8c3a71db-3a82-4a8d-af42-2922242ed8b4. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:56:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Acquiring lock "cinder-3e3927ec-4405-4d7e-892d-75e4e9ae6e51-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:56:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Lock "cinder-3e3927ec-4405-4d7e-892d-75e4e9ae6e51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:56:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Acquiring lock "cinder-quobyte-3e3927ec-4405-4d7e-892d-75e4e9ae6e51" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:56:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Lock "cinder-quobyte-3e3927ec-4405-4d7e-892d-75e4e9ae6e51" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:56:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f17b6bd-87bf-451f-9f59-d8529478be8e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:56:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:03 devstack sudo[102629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51
Jul 17 03:56:03 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:04 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:04 devstack sudo[102634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51
Jul 17 03:56:04 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:04 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3e3927ec-4405-4d7e-892d-75e4e9ae6e51" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Lock "cinder-quobyte-3e3927ec-4405-4d7e-892d-75e4e9ae6e51" released by "delete_volume" :: held 0.628s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Created reservations ['f5043064-a624-492b-927e-ba02fa09d22d', '8d0d0948-c03d-4df8-9191-e20ab600c610', 'f61e89b4-4270-40bc-ac2a-1f775b9d9fac', 'f85942c1-a891-4432-b67d-bc86e25ffeaf'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:04 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:56:04 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:04 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:56:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Deleted volume successfully.
Jul 17 03:56:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-349a1938-6b99-493d-a4e0-1e9732cb3203 tempest-TestMinimumBasicScenario-583098845 None] Lock "cinder-3e3927ec-4405-4d7e-892d-75e4e9ae6e51-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:12 devstack sudo[102669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:56:12 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:12 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:56:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:56:14 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:56:14 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:56:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:56:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Flow 'volume_create_manager' (82b93942-8840-440c-ad9a-4acc77e1db47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e529d9d-372b-4d4e-9a22-ac2b050e34f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e529d9d-372b-4d4e-9a22-ac2b050e34f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2045954006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d0ace8-cd17-4727-bc5d-bda25150eb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762c72c5aae948eb85c1d49b388f6f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:56:35Z,use_quota=True,user_id='29ed358bc8794cc1bc6385dad80a1f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718fedc6-6e38-48df-af2f-8eeba277e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718fedc6-6e38-48df-af2f-8eeba277e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c79725-7580-49c1-8658-0ccdfdce422d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c79725-7580-49c1-8658-0ccdfdce422d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6d0ace8-cd17-4727-bc5d-bda25150eb0d', 'volume_name': 'volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05119181-7d28-4b4a-bd8b-620453a1f1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05119181-7d28-4b4a-bd8b-620453a1f1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43d2d13-e62d-4a94-a277-d345897d80e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Volume d6d0ace8-cd17-4727-bc5d-bda25150eb0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d', 'volume_size': 1}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2045954006',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6d0ace8-cd17-4727-bc5d-bda25150eb0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762c72c5aae948eb85c1d49b388f6f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:56:35Z,use_quota=True,user_id='29ed358bc8794cc1bc6385dad80a1f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Creating volume d6d0ace8-cd17-4727-bc5d-bda25150eb0d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:56:34 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:34 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d 1073741824
Jul 17 03:56:34 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Flow 'volume_create_manager' (244076aa-3468-4bb6-805e-e327ea88a659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa977a55-0057-4fbc-a89f-7c2699e9163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa977a55-0057-4fbc-a89f-7c2699e9163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1346922975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c72b337-a8d9-4aca-81eb-44629a366cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762c72c5aae948eb85c1d49b388f6f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:56:35Z,use_quota=True,user_id='29ed358bc8794cc1bc6385dad80a1f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f214a8e6-fce9-4724-888b-ca90503961c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f214a8e6-fce9-4724-888b-ca90503961c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20db1c6f-7e28-480f-bdac-2d0d27243cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20db1c6f-7e28-480f-bdac-2d0d27243cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c72b337-a8d9-4aca-81eb-44629a366cd8', 'volume_name': 'volume-8c72b337-a8d9-4aca-81eb-44629a366cd8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf25b722-b18c-4b7c-ad80-f1ef77e243df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf25b722-b18c-4b7c-ad80-f1ef77e243df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55dba73-c096-4872-b61b-61b239a5fa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Volume 8c72b337-a8d9-4aca-81eb-44629a366cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c72b337-a8d9-4aca-81eb-44629a366cd8', 'volume_size': 1}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:56:35 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d 1073741824" returned: 0 in 0.573s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:35 devstack sudo[102683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d
Jul 17 03:56:35 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:35 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d" returned: 0 in 0.263s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1346922975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c72b337-a8d9-4aca-81eb-44629a366cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='762c72c5aae948eb85c1d49b388f6f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:56:35Z,use_quota=True,user_id='29ed358bc8794cc1bc6385dad80a1f3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Creating volume 8c72b337-a8d9-4aca-81eb-44629a366cd8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:56:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43d2d13-e62d-4a94-a277-d345897d80e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16962dba-66ea-483e-bee6-9cf5a87242f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:35 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8 1073741824
Jul 17 03:56:35 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Volume volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d (d6d0ace8-cd17-4727-bc5d-bda25150eb0d): created successfully
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16962dba-66ea-483e-bee6-9cf5a87242f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Flow 'volume_create_manager' (82b93942-8840-440c-ad9a-4acc77e1db47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:56:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e000e662-8aee-49cd-a00f-d1f6ed4a5575 tempest-TestServerVolumeAttachmentScenario-229029850 None] Created volume successfully.
Jul 17 03:56:36 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8 1073741824" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:56:36 devstack sudo[102692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8
Jul 17 03:56:36 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:56:36 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55dba73-c096-4872-b61b-61b239a5fa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c72b337-a8d9-4aca-81eb-44629a366cd8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ba3dd0-14f8-4c73-8861-1b2b5935edb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:56:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Volume volume-8c72b337-a8d9-4aca-81eb-44629a366cd8 (8c72b337-a8d9-4aca-81eb-44629a366cd8): created successfully
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ba3dd0-14f8-4c73-8861-1b2b5935edb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:56:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Flow 'volume_create_manager' (244076aa-3468-4bb6-805e-e327ea88a659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:56:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-401e89ee-038f-4608-b301-b0b2b21d3cb7 tempest-TestServerVolumeAttachmentScenario-229029850 None] Created volume successfully.
Jul 17 03:56:46 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:56:46 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:57:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-2e4e13ca-b9c0-4a69-84bb-177ab1026c96 req-f6aff14e-19eb-4689-9f6e-0e4e4067b761 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:57:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-2e4e13ca-b9c0-4a69-84bb-177ab1026c96 req-f6aff14e-19eb-4689-9f6e-0e4e4067b761 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:57:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-2e4e13ca-b9c0-4a69-84bb-177ab1026c96 req-f6aff14e-19eb-4689-9f6e-0e4e4067b761 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:57:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-2e4e13ca-b9c0-4a69-84bb-177ab1026c96 req-f6aff14e-19eb-4689-9f6e-0e4e4067b761 tempest-TestServerVolumeAttachmentScenario-229029850 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c05b4f8-f790-4261-9581-b801959807e1', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:57:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-2e4e13ca-b9c0-4a69-84bb-177ab1026c96 req-f6aff14e-19eb-4689-9f6e-0e4e4067b761 tempest-TestServerVolumeAttachmentScenario-229029850 None] attachment_update completed successfully.
Jul 17 03:57:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-82dd1f08-14e1-4591-8322-0a02bcbae9a4 req-c03dfaa2-327e-43c1-8824-baf6c268da7b tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:57:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-82dd1f08-14e1-4591-8322-0a02bcbae9a4 req-c03dfaa2-327e-43c1-8824-baf6c268da7b tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:57:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-82dd1f08-14e1-4591-8322-0a02bcbae9a4 req-c03dfaa2-327e-43c1-8824-baf6c268da7b tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:57:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-82dd1f08-14e1-4591-8322-0a02bcbae9a4 req-c03dfaa2-327e-43c1-8824-baf6c268da7b tempest-TestServerVolumeAttachmentScenario-229029850 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-8c72b337-a8d9-4aca-81eb-44629a366cd8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06056ee4-43a9-43c9-9dcb-403e0cc3bdea', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:57:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-82dd1f08-14e1-4591-8322-0a02bcbae9a4 req-c03dfaa2-327e-43c1-8824-baf6c268da7b tempest-TestServerVolumeAttachmentScenario-229029850 None] attachment_update completed successfully.
Jul 17 03:57:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-8e3c702f-eb85-49c7-8a84-185d10724019 req-fb0fc8c4-75d6-47c2-9ed8-fa5678a31831 tempest-TestServerVolumeAttachmentScenario-229029850 None] Terminate volume connection completed successfully.
Jul 17 03:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-8e3c702f-eb85-49c7-8a84-185d10724019 req-fb0fc8c4-75d6-47c2-9ed8-fa5678a31831 tempest-TestServerVolumeAttachmentScenario-229029850 None] Deleting attachment 06056ee4-43a9-43c9-9dcb-403e0cc3bdea. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:57:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-35061cf7-612c-4233-8238-6f322ef5c568 req-203fbafc-0496-404e-8867-d28743dea101 tempest-TestServerVolumeAttachmentScenario-229029850 None] Terminate volume connection completed successfully.
Jul 17 03:57:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-35061cf7-612c-4233-8238-6f322ef5c568 req-203fbafc-0496-404e-8867-d28743dea101 tempest-TestServerVolumeAttachmentScenario-229029850 None] Deleting attachment 8c05b4f8-f790-4261-9581-b801959807e1. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:12 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:57:12 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:12 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:57:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "cinder-8c72b337-a8d9-4aca-81eb-44629a366cd8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-8c72b337-a8d9-4aca-81eb-44629a366cd8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "cinder-quobyte-8c72b337-a8d9-4aca-81eb-44629a366cd8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-quobyte-8c72b337-a8d9-4aca-81eb-44629a366cd8" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7882376c-7c1a-4c8b-a209-df8a082068a7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:16 devstack sudo[103320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8
Jul 17 03:57:16 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:16 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:16 devstack sudo[103325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8
Jul 17 03:57:16 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:16 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8c72b337-a8d9-4aca-81eb-44629a366cd8" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-quobyte-8c72b337-a8d9-4aca-81eb-44629a366cd8" released by "delete_volume" :: held 0.631s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Created reservations ['8a9b7f5e-3b73-4651-b025-c3f529b9b858', '2ff0cd70-1bef-4c38-a319-5e66a377e1b9', '0c9ccdcb-2129-4f95-a30b-64f4c97ef7f6', '92bf2a14-5b47-4299-b6d8-87c49f61a3f4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:16 devstack sudo[103328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:57:16 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:17 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:57:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Deleted volume successfully.
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0df15f81-495d-46ee-80c5-51b46a8dc642 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-8c72b337-a8d9-4aca-81eb-44629a366cd8-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "cinder-d6d0ace8-cd17-4727-bc5d-bda25150eb0d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-d6d0ace8-cd17-4727-bc5d-bda25150eb0d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "cinder-quobyte-d6d0ace8-cd17-4727-bc5d-bda25150eb0d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-quobyte-d6d0ace8-cd17-4727-bc5d-bda25150eb0d" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d9a7b-5990-4f6e-87a0-315107dc62a2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:17 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d
Jul 17 03:57:17 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:17 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:17 devstack sudo[103336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d
Jul 17 03:57:17 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:18 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d6d0ace8-cd17-4727-bc5d-bda25150eb0d" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-quobyte-d6d0ace8-cd17-4727-bc5d-bda25150eb0d" released by "delete_volume" :: held 0.634s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Created reservations ['995d6c05-8352-43b8-9c54-c67c779ed890', 'b7574c40-c799-407c-8af5-f78e465239a2', '9530c20f-456e-4a0f-b49b-5719903ffbf8', '3277dbe6-fd72-4542-84bc-6c1e9e7ed812'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:18 devstack sudo[103339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:57:18 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:18 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:57:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Deleted volume successfully.
Jul 17 03:57:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9b5e6c50-40de-4787-8ed9-a16e86783be5 tempest-TestServerVolumeAttachmentScenario-229029850 None] Lock "cinder-d6d0ace8-cd17-4727-bc5d-bda25150eb0d-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:57:28 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=21,cinder:UPDATE=20,cinder:INSERT=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:57:28 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=29,cinder:UPDATE=18,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Flow 'volume_create_manager' (540e4212-1f8b-4aea-a5f3-de2be0e5c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07d2518-d052-4f30-88ae-940a1ca403de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07d2518-d052-4f30-88ae-940a1ca403de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1209150401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98c3d9f-04ea-4015-aaf7-88bf2afef64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a601a0be145568a715ff47076286c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:57:49Z,use_quota=True,user_id='2fdc54b8af4f4afcb425a1fd240358f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef661847-dfac-40b5-874f-f0639421522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef661847-dfac-40b5-874f-f0639421522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4874971d-c66a-4a5d-8cbd-3c59c4fc24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4874971d-c66a-4a5d-8cbd-3c59c4fc24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98c3d9f-04ea-4015-aaf7-88bf2afef64d', 'volume_name': 'volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6948770b-e6a7-43df-a04a-389a1c19b117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6948770b-e6a7-43df-a04a-389a1c19b117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c7013-b73d-458e-8890-32d7bad1197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:57:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Volume f98c3d9f-04ea-4015-aaf7-88bf2afef64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d', 'volume_size': 1}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1209150401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98c3d9f-04ea-4015-aaf7-88bf2afef64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a601a0be145568a715ff47076286c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:57:49Z,use_quota=True,user_id='2fdc54b8af4f4afcb425a1fd240358f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Creating volume f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:57:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:49 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d 1073741824
Jul 17 03:57:49 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:49 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d 1073741824" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:57:49 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d
Jul 17 03:57:49 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:57:50 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Jul 17 03:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d3c7013-b73d-458e-8890-32d7bad1197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc4fc6c-ea39-4aea-81bd-6c3d0c4bff15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:57:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Volume volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d (f98c3d9f-04ea-4015-aaf7-88bf2afef64d): created successfully
Jul 17 03:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc4fc6c-ea39-4aea-81bd-6c3d0c4bff15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Flow 'volume_create_manager' (540e4212-1f8b-4aea-a5f3-de2be0e5c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:57:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-76dbe982-afe8-4ca9-9291-c5040ad74699 tempest-TestStampPattern-954057167 None] Created volume successfully.
Jul 17 03:58:00 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:58:00 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:12 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:58:12 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:12 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:58:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0364b437-7450-413e-96ad-c30cb49ee2ab req-06eac2e8-666b-48a0-9977-84e9b36e3895 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0364b437-7450-413e-96ad-c30cb49ee2ab req-06eac2e8-666b-48a0-9977-84e9b36e3895 tempest-TestStampPattern-954057167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0364b437-7450-413e-96ad-c30cb49ee2ab req-06eac2e8-666b-48a0-9977-84e9b36e3895 tempest-TestStampPattern-954057167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:58:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0364b437-7450-413e-96ad-c30cb49ee2ab req-06eac2e8-666b-48a0-9977-84e9b36e3895 tempest-TestStampPattern-954057167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fede1b94-687b-4016-879b-005a0530178e', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:58:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0364b437-7450-413e-96ad-c30cb49ee2ab req-06eac2e8-666b-48a0-9977-84e9b36e3895 tempest-TestStampPattern-954057167 None] attachment_update completed successfully.
Jul 17 03:58:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-a00ccf59-8ab1-4535-8dc8-efebcf9c19d9 req-85a1523c-0fdf-446c-8bf1-d554f6dacdb1 tempest-TestStampPattern-954057167 None] Terminate volume connection completed successfully.
Jul 17 03:58:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-a00ccf59-8ab1-4535-8dc8-efebcf9c19d9 req-85a1523c-0fdf-446c-8bf1-d554f6dacdb1 tempest-TestStampPattern-954057167 None] Deleting attachment fede1b94-687b-4016-879b-005a0530178e. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:58:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:58:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:58:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Creating offline snapshot 8645ee38-5cc9-4dae-abf1-7aa43aed09a8 of volume f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 03:58:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[20505092-6429-435e-b2a0-ab4ccbcdd60d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:58:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:23 devstack sudo[103966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d
Jul 17 03:58:23 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:24 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:24 devstack sudo[103971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 1G
Jul 17 03:58:24 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:24 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 1G" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:24 devstack sudo[103977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8
Jul 17 03:58:24 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:24 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:24 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 is being set with open permissions: ugo+rw
Jul 17 03:58:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:24 devstack sudo[103982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8
Jul 17 03:58:24 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:25 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:25 devstack sudo[103985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.info
Jul 17 03:58:25 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:25 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.info" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:25 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.info is being set with open permissions: ugo+rw
Jul 17 03:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:25 devstack sudo[103988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.info
Jul 17 03:58:25 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:25 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:58:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-024d9a06-ef01-4aba-9d6d-90ca2eb291ed tempest-TestStampPattern-954057167 None] Create snapshot completed successfully
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Flow 'volume_create_manager' (0f5652b5-4922-4df9-af22-f2cd79dc4905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a81826-46fd-43d1-a626-12fd04e70fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a81826-46fd-43d1-a626-12fd04e70fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-961256425',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8efab05-14d4-4fac-bce4-360f421d082e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7a601a0be145568a715ff47076286c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8645ee38-5cc9-4dae-abf1-7aa43aed09a8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:58:32Z,use_quota=True,user_id='2fdc54b8af4f4afcb425a1fd240358f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1660d280-80ce-48b0-8578-dd7aa636909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1660d280-80ce-48b0-8578-dd7aa636909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dae457d-b5e2-4037-a597-aae4e44e7d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dae457d-b5e2-4037-a597-aae4e44e7d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8efab05-14d4-4fac-bce4-360f421d082e', 'volume_name': 'volume-e8efab05-14d4-4fac-bce4-360f421d082e', 'volume_size': 1, 'snapshot_id': '8645ee38-5cc9-4dae-abf1-7aa43aed09a8'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7685fec9-0786-4885-9cd6-b0cea43faeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7685fec9-0786-4885-9cd6-b0cea43faeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10a758b-ecb5-4c42-9a5f-250a95e4fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:58:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Volume e8efab05-14d4-4fac-bce4-360f421d082e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8efab05-14d4-4fac-bce4-360f421d082e', 'volume_size': 1, 'snapshot_id': '8645ee38-5cc9-4dae-abf1-7aa43aed09a8'}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-quobyte-8645ee38-5cc9-4dae-abf1-7aa43aed09a8-e8efab05-14d4-4fac-bce4-360f421d082e" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-8645ee38-5cc9-4dae-abf1-7aa43aed09a8-e8efab05-14d4-4fac-bce4-360f421d082e" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Creating volume e8efab05-14d4-4fac-bce4-360f421d082e from snapshot 8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-quobyte-e8efab05-14d4-4fac-bce4-360f421d082e" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-e8efab05-14d4-4fac-bce4-360f421d082e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] snapshot: 8645ee38-5cc9-4dae-abf1-7aa43aed09a8, volume: e8efab05-14d4-4fac-bce4-360f421d082e,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c794b5c-fff4-47f7-a2d4-c7ba188b1583]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:32 devstack sudo[104025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8
Jul 17 03:58:32 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:33 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8" returned: 0 in 0.463s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[357e71cc-ad3e-4296-9f31-424e2052207b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:33 devstack sudo[104030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d
Jul 17 03:58:33 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:33 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 03:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:33 devstack sudo[104038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e
Jul 17 03:58:33 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:39 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e" returned: 0 in 5.698s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b926212-bf3a-42c8-a7dd-3767ab9d7b5a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:39 devstack sudo[104090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d
Jul 17 03:58:39 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:39 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" returned: 0 in 0.658s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:39 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:58:39 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Converted 1024.00 MB image at 179.66 MB/s
Jul 17 03:58:39 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e is being set with open permissions: ugo+rw
Jul 17 03:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:58:39 devstack sudo[104112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e
Jul 17 03:58:39 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:58:40 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-e8efab05-14d4-4fac-bce4-360f421d082e" released by "_copy_volume_from_snapshot" :: held 7.609s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-8645ee38-5cc9-4dae-abf1-7aa43aed09a8-e8efab05-14d4-4fac-bce4-360f421d082e" released by "_create_volume_from_snapshot" :: held 7.648s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.678s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10a758b-ecb5-4c42-9a5f-250a95e4fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8efab05-14d4-4fac-bce4-360f421d082e', 'volume_size': 1, 'snapshot_id': '8645ee38-5cc9-4dae-abf1-7aa43aed09a8'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140d6d09-c709-4120-93fa-ccba4e1e1c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:58:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Volume volume-e8efab05-14d4-4fac-bce4-360f421d082e (e8efab05-14d4-4fac-bce4-360f421d082e): created successfully
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (140d6d09-c709-4120-93fa-ccba4e1e1c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Flow 'volume_create_manager' (0f5652b5-4922-4df9-af22-f2cd79dc4905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:58:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7cdb6acd-e8d0-4c94-a2e1-7b1e87c72d94 tempest-TestStampPattern-954057167 None] Created volume successfully.
Jul 17 03:58:50 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=12,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:58:50 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:12 devstack sudo[104187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:59:12 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:12 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 03:59:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 03:59:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-34f2bb44-fd96-4e96-a6a7-bda04bbc3e5c req-e4b79d3b-54a6-4cb5-b3ac-a34a48e1f2e1 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:59:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-34f2bb44-fd96-4e96-a6a7-bda04bbc3e5c req-e4b79d3b-54a6-4cb5-b3ac-a34a48e1f2e1 tempest-TestStampPattern-954057167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:59:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e964c4-a046-4663-87f6-9f7a51bea09d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-34f2bb44-fd96-4e96-a6a7-bda04bbc3e5c req-e4b79d3b-54a6-4cb5-b3ac-a34a48e1f2e1 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:22 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e
Jul 17 03:59:22 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:22 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-34f2bb44-fd96-4e96-a6a7-bda04bbc3e5c req-e4b79d3b-54a6-4cb5-b3ac-a34a48e1f2e1 tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-34f2bb44-fd96-4e96-a6a7-bda04bbc3e5c req-e4b79d3b-54a6-4cb5-b3ac-a34a48e1f2e1 tempest-TestStampPattern-954057167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.378s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-34f2bb44-fd96-4e96-a6a7-bda04bbc3e5c req-e4b79d3b-54a6-4cb5-b3ac-a34a48e1f2e1 tempest-TestStampPattern-954057167 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5', 'name': 'volume-e8efab05-14d4-4fac-bce4-360f421d082e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4e802ca-358f-44dd-b715-64d7f3325906', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 17 03:59:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-34f2bb44-fd96-4e96-a6a7-bda04bbc3e5c req-e4b79d3b-54a6-4cb5-b3ac-a34a48e1f2e1 tempest-TestStampPattern-954057167 None] attachment_update completed successfully.
Jul 17 03:59:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-c060d268-45fe-4d16-ad2b-c69a4ced163f req-e8908c09-89c7-4f45-80bb-38a9ef5a64fb tempest-TestStampPattern-954057167 None] Terminate volume connection completed successfully.
Jul 17 03:59:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-c060d268-45fe-4d16-ad2b-c69a4ced163f req-e8908c09-89c7-4f45-80bb-38a9ef5a64fb tempest-TestStampPattern-954057167 None] Deleting attachment e4e802ca-358f-44dd-b715-64d7f3325906. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-e8efab05-14d4-4fac-bce4-360f421d082e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Lock "cinder-e8efab05-14d4-4fac-bce4-360f421d082e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-quobyte-e8efab05-14d4-4fac-bce4-360f421d082e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-e8efab05-14d4-4fac-bce4-360f421d082e" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10f3691-5970-420e-b510-84873c4dcbf8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:29 devstack sudo[104663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e
Jul 17 03:59:29 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:29 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:29 devstack sudo[104668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e
Jul 17 03:59:29 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:29 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e8efab05-14d4-4fac-bce4-360f421d082e" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-e8efab05-14d4-4fac-bce4-360f421d082e" released by "delete_volume" :: held 0.631s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Created reservations ['47618684-14e1-4b05-a015-227cd6cd8f81', '8ea78764-f50e-4aed-9108-0e757282210b', '15b3d96b-1591-4654-9881-ca5b6793c08b', 'bc049fec-135e-46bd-83d0-89513d92381a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:30 devstack sudo[104671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:59:30 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:30 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:59:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Deleted volume successfully.
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2aa84792-dedc-4811-995e-1b40f3021826 tempest-TestStampPattern-954057167 None] Lock "cinder-e8efab05-14d4-4fac-bce4-360f421d082e-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-8645ee38-5cc9-4dae-abf1-7aa43aed09a8-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Lock "cinder-8645ee38-5cc9-4dae-abf1-7aa43aed09a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-quobyte-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-quobyte-8645ee38-5cc9-4dae-abf1-7aa43aed09a8" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-8645ee38-5cc9-4dae-abf1-7aa43aed09a8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Deleting offline snapshot 8645ee38-5cc9-4dae-abf1-7aa43aed09a8 of volume f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] snapshot_file for this snap is: volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[44adfa89-398b-41db-acdb-ee387bd29322]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:30 devstack sudo[104674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8
Jul 17 03:59:30 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:31 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37288887-5059-497c-be5b-50a4da254a8f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:31 devstack sudo[104679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d
Jul 17 03:59:31 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:31 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:31 devstack sudo[104684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8
Jul 17 03:59:31 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:31 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:31 devstack sudo[104689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8
Jul 17 03:59:31 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:32 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d.8645ee38-5cc9-4dae-abf1-7aa43aed09a8" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-8645ee38-5cc9-4dae-abf1-7aa43aed09a8" released by "_delete_snapshot" :: held 1.382s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" released by "delete_snapshot" :: held 1.403s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Created reservations ['ea716522-c6ad-4cfa-a540-6b477ac9d64b', '3147693a-c19c-4c86-a653-c04eb86069fb', '73e262d7-11b3-4262-af3f-516dc4bdd32c', 'a72cebb1-5a6a-4849-bee8-e38bdbe6f192'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:59:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Delete snapshot completed successfully.
Jul 17 03:59:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0ea7a0a4-943a-41ee-a826-a4322cbbaaeb tempest-TestStampPattern-954057167 None] Lock "cinder-8645ee38-5cc9-4dae-abf1-7aa43aed09a8-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-f98c3d9f-04ea-4015-aaf7-88bf2afef64d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Lock "cinder-f98c3d9f-04ea-4015-aaf7-88bf2afef64d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Acquiring lock "cinder-quobyte-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a9d740-5c27-4112-baac-24347787788f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:36 devstack sudo[104724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d
Jul 17 03:59:36 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:37 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:37 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d
Jul 17 03:59:37 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:37 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Lock "cinder-quobyte-f98c3d9f-04ea-4015-aaf7-88bf2afef64d" released by "delete_volume" :: held 0.648s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Created reservations ['5c26bef6-ba0a-449f-8fd5-88cea3cae0ec', 'b51c947c-6839-487a-adb1-05abcaee2ca1', '49f5a989-f518-46ed-b0e1-f946ee6c209e', 'a1c79618-d3a7-4fdd-9d56-21ab79bc902f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:37 devstack sudo[104732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:59:37 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:37 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:59:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Deleted volume successfully.
Jul 17 03:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-55041da6-6d98-4b01-9859-f6d4d9447eb2 tempest-TestStampPattern-954057167 None] Lock "cinder-f98c3d9f-04ea-4015-aaf7-88bf2afef64d-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:47 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:59:47 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Flow 'volume_create_manager' (25f381f0-8cd2-4251-a7b3-2dc4a3b9b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c23fd5-51a0-4b86-a15c-bbe68092d30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c23fd5-51a0-4b86-a15c-bbe68092d30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b368ca99-b308-4a42-9925-0b35bcc0d751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467763b1e8e46779cad532c277c6f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:59:50Z,use_quota=True,user_id='2ac5a85b6aaf496583a51e1bdf7674b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d195c753-2e8d-4c1c-8410-9d2fb48d78c5),volume_type_id=d195c753-2e8d-4c1c-8410-9d2fb48d78c5)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e2d4ef-1e3b-4b4b-a952-1b9c93a8f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e2d4ef-1e3b-4b4b-a952-1b9c93a8f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bc358f-5c83-484f-a568-e7abc8c04f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bc358f-5c83-484f-a568-e7abc8c04f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b368ca99-b308-4a42-9925-0b35bcc0d751', 'volume_name': 'volume-b368ca99-b308-4a42-9925-0b35bcc0d751', 'volume_size': 1, 'image_id': '675aadf0-fda8-4353-b652-f3392622fbf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/675aadf0-fda8-4353-b652-f3392622fbf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41f6c37c5a390590f28e9cf6b5fef6eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c467763b1e8e46779cad532c277c6f20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b8e30088ee5e9da967224879328a583f12bb8e3b5b5c3fad494c13ae29bca632af2fb2cf9b4b1599fbce4ebaa0e9ec55ab44011394ec0ef0ece4948db30f732', 'id': '675aadf0-fda8-4353-b652-f3392622fbf7', 'created_at': datetime.datetime(2026, 7, 17, 1, 59, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 59, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/675aadf0-fda8-4353-b652-f3392622fbf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf9e2d0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17805ecd-1fde-4bb0-beb2-23d64b4c9c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17805ecd-1fde-4bb0-beb2-23d64b4c9c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dc35e6-e071-46b7-9d1f-31f76447cf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:59:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Volume b368ca99-b308-4a42-9925-0b35bcc0d751: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b368ca99-b308-4a42-9925-0b35bcc0d751', 'volume_size': 1, 'image_id': '675aadf0-fda8-4353-b652-f3392622fbf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/675aadf0-fda8-4353-b652-f3392622fbf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41f6c37c5a390590f28e9cf6b5fef6eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c467763b1e8e46779cad532c277c6f20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b8e30088ee5e9da967224879328a583f12bb8e3b5b5c3fad494c13ae29bca632af2fb2cf9b4b1599fbce4ebaa0e9ec55ab44011394ec0ef0ece4948db30f732', 'id': '675aadf0-fda8-4353-b652-f3392622fbf7', 'created_at': datetime.datetime(2026, 7, 17, 1, 59, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 59, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/675aadf0-fda8-4353-b652-f3392622fbf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf9e2d0>}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Trying to clone b368ca99-b308-4a42-9925-0b35bcc0d751 from image 675aadf0-fda8-4353-b652-f3392622fbf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/675aadf0-fda8-4353-b652-f3392622fbf7', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 03:59:50 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Image download 0.00 MB at 0.00 MB/s
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83e0439-111d-46bb-873d-3ac713e16073]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:50 devstack sudo[104783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD
Jul 17 03:59:50 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:51 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:51 devstack sudo[104787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD
Jul 17 03:59:51 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:51 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Temporary image 675aadf0-fda8-4353-b652-f3392622fbf7 is fetched for user 2ac5a85b6aaf496583a51e1bdf7674b4. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[52428fd6-bfb5-4889-bca6-1f8ce76e8cad]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:51 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD
Jul 17 03:59:51 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:51 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:51 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD
Jul 17 03:59:51 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:52 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T01:59:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b368ca99-b308-4a42-9925-0b35bcc0d751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c467763b1e8e46779cad532c277c6f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T01:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T01:59:50Z,use_quota=True,user_id='2ac5a85b6aaf496583a51e1bdf7674b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d195c753-2e8d-4c1c-8410-9d2fb48d78c5),volume_type_id=d195c753-2e8d-4c1c-8410-9d2fb48d78c5)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Creating volume b368ca99-b308-4a42-9925-0b35bcc0d751 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 03:59:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:52 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 1073741824
Jul 17 03:59:52 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:52 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 1073741824" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:52 devstack sudo[104806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751
Jul 17 03:59:52 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:52 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Attempting download of 675aadf0-fda8-4353-b652-f3392622fbf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/675aadf0-fda8-4353-b652-f3392622fbf7', 'metadata': {}}])) to volume b368ca99-b308-4a42-9925-0b35bcc0d751. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[124b14ae-59a8-4843-8c87-8a21c29ecaff]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_675aadf0-fda8-4353-b652-f3392622fbf7_ibe4lk0u {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:52 devstack sudo[104809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_675aadf0-fda8-4353-b652-f3392622fbf7_ibe4lk0u
Jul 17 03:59:52 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:53 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_675aadf0-fda8-4353-b652-f3392622fbf7_ibe4lk0u" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_675aadf0-fda8-4353-b652-f3392622fbf7_ibe4lk0u {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:53 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_675aadf0-fda8-4353-b652-f3392622fbf7_ibe4lk0u
Jul 17 03:59:53 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:53 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_675aadf0-fda8-4353-b652-f3392622fbf7_ibe4lk0u" returned: 1 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_675aadf0-fda8-4353-b652-f3392622fbf7_ibe4lk0u' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[41897cad-11b3-4dbe-893c-db5af62799f6]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:53 devstack sudo[104817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD
Jul 17 03:59:53 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:53 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:53 devstack sudo[104821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD
Jul 17 03:59:53 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:54 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD" returned: 1 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] 675aadf0-fda8-4353-b652-f3392622fbf7 was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:54 devstack sudo[104826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751
Jul 17 03:59:54 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:54 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_675aadf0-fda8-4353-b652-f3392622fbf7_bpgbgprbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 03:59:54 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Converted 0.00 MB image at 0.00 MB/s
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:54 devstack sudo[104832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 1G
Jul 17 03:59:54 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:54 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 1G" returned: 0 in 0.306s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Downloaded image 675aadf0-fda8-4353-b652-f3392622fbf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/675aadf0-fda8-4353-b652-f3392622fbf7', 'metadata': {}}])) to volume b368ca99-b308-4a42-9925-0b35bcc0d751 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Temporary image 675aadf0-fda8-4353-b652-f3392622fbf7 for user 2ac5a85b6aaf496583a51e1bdf7674b4 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Marking volume b368ca99-b308-4a42-9925-0b35bcc0d751 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Copying metadata from image 675aadf0-fda8-4353-b652-f3392622fbf7 to b368ca99-b308-4a42-9925-0b35bcc0d751. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Creating volume glance metadata for volume b368ca99-b308-4a42-9925-0b35bcc0d751 backed by image 675aadf0-fda8-4353-b652-f3392622fbf7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '675aadf0-fda8-4353-b652-f3392622fbf7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '41f6c37c5a390590f28e9cf6b5fef6eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dc35e6-e071-46b7-9d1f-31f76447cf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b368ca99-b308-4a42-9925-0b35bcc0d751', 'volume_size': 1, 'image_id': '675aadf0-fda8-4353-b652-f3392622fbf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/675aadf0-fda8-4353-b652-f3392622fbf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '41f6c37c5a390590f28e9cf6b5fef6eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c467763b1e8e46779cad532c277c6f20', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b8e30088ee5e9da967224879328a583f12bb8e3b5b5c3fad494c13ae29bca632af2fb2cf9b4b1599fbce4ebaa0e9ec55ab44011394ec0ef0ece4948db30f732', 'id': '675aadf0-fda8-4353-b652-f3392622fbf7', 'created_at': datetime.datetime(2026, 7, 17, 1, 59, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 1, 59, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/675aadf0-fda8-4353-b652-f3392622fbf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf9e2d0>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d095449-b3e5-4d99-982b-bd69de03d5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 03:59:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Volume volume-b368ca99-b308-4a42-9925-0b35bcc0d751 (b368ca99-b308-4a42-9925-0b35bcc0d751): created successfully
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d095449-b3e5-4d99-982b-bd69de03d5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 03:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Flow 'volume_create_manager' (25f381f0-8cd2-4251-a7b3-2dc4a3b9b143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 03:59:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3948890d-eca5-445a-8e5c-bf3dd68bb766 tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Created volume successfully.
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Acquiring lock "cinder-b368ca99-b308-4a42-9925-0b35bcc0d751-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "cinder-b368ca99-b308-4a42-9925-0b35bcc0d751-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Acquiring lock "cinder-quobyte-b368ca99-b308-4a42-9925-0b35bcc0d751" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "cinder-quobyte-b368ca99-b308-4a42-9925-0b35bcc0d751" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a6d600-4bd1-4efe-bd1a-b41b3f621515]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:55 devstack sudo[104837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751
Jul 17 03:59:55 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:55 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:55 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751
Jul 17 03:59:55 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:56 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b368ca99-b308-4a42-9925-0b35bcc0d751" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "cinder-quobyte-b368ca99-b308-4a42-9925-0b35bcc0d751" released by "delete_volume" :: held 0.627s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 03:59:56 devstack cinder-volume[87498]: WARNING cinder.quota [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:59:56 devstack cinder-volume[87498]: WARNING cinder.quota [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Created reservations ['3f9ea635-8d4a-4507-8633-44e8b59a989d', '90d9f603-f926-4c66-9d94-4ce755433980', '0ee32770-7eae-4dd4-83ba-d9ec764db2ed', 'de1885e4-d219-41b5-b5c3-617edb9fe9cc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 03:59:56 devstack sudo[104846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 03:59:56 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 03:59:56 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 03:59:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Deleted volume successfully.
Jul 17 03:59:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79eec2cf-2127-4911-bc19-163cda83b96e tempest-VolumeAndVolumeTypeFromImageTest-1642988131 None] Lock "cinder-b368ca99-b308-4a42-9925-0b35bcc0d751-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Flow 'volume_create_manager' (986f0ba0-9510-4f69-979d-5ac266c0a07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aec747-21aa-44e2-98c8-35b21dcd33bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aec747-21aa-44e2-98c8-35b21dcd33bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1177f083-27b5-418f-adc9-b6a2e70e1a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cd9a4da0504e6794819e26aa0a3ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:03Z,use_quota=True,user_id='55233319efd340cd927772695c62b0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed7362b-b5c8-4152-8fb7-10c7fc9a028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed7362b-b5c8-4152-8fb7-10c7fc9a028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd80fac-fdae-4baa-a12e-f5cd72cdc98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cd80fac-fdae-4baa-a12e-f5cd72cdc98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1177f083-27b5-418f-adc9-b6a2e70e1a1c', 'volume_name': 'volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c', 'volume_size': 1, 'image_id': '66c8d884-8875-4094-ac2d-947c1bd00aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66c8d884-8875-4094-ac2d-947c1bd00aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '580323d180a9ae4d1a04cb2f84a89d89', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66cd9a4da0504e6794819e26aa0a3ddc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c95958b2ee7a7ae8cb0580295149777ad41c7b9ef2cc435b48e27e80c44fac4208773e0bff94ef5d52b73687f357923a2e3c939ed88f0a158ff735fe9637baa9', 'id': '66c8d884-8875-4094-ac2d-947c1bd00aa4', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66c8d884-8875-4094-ac2d-947c1bd00aa4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cfd2180>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b1719-af5f-470e-9b3b-104e047bd98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b1719-af5f-470e-9b3b-104e047bd98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde46727-cf61-4521-abdc-a8936dc2b781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Volume 1177f083-27b5-418f-adc9-b6a2e70e1a1c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c', 'volume_size': 1, 'image_id': '66c8d884-8875-4094-ac2d-947c1bd00aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66c8d884-8875-4094-ac2d-947c1bd00aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '580323d180a9ae4d1a04cb2f84a89d89', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66cd9a4da0504e6794819e26aa0a3ddc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c95958b2ee7a7ae8cb0580295149777ad41c7b9ef2cc435b48e27e80c44fac4208773e0bff94ef5d52b73687f357923a2e3c939ed88f0a158ff735fe9637baa9', 'id': '66c8d884-8875-4094-ac2d-947c1bd00aa4', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66c8d884-8875-4094-ac2d-947c1bd00aa4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cfd2180>}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Trying to clone 1177f083-27b5-418f-adc9-b6a2e70e1a1c from image 66c8d884-8875-4094-ac2d-947c1bd00aa4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/66c8d884-8875-4094-ac2d-947c1bd00aa4', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 04:00:02 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 04:00:02 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Image download 0.00 MB at 0.00 MB/s
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39d3da1-02f9-414a-9f87-ac73e160c494]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:03 devstack sudo[104851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD
Jul 17 04:00:03 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:03 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:03 devstack sudo[104855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD
Jul 17 04:00:03 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:03 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Temporary image 66c8d884-8875-4094-ac2d-947c1bd00aa4 is fetched for user 55233319efd340cd927772695c62b0b3. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c067519-654c-482d-9d42-1ac82aadb836]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:03 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD
Jul 17 04:00:03 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:04 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:04 devstack sudo[104864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD
Jul 17 04:00:04 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:04 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1177f083-27b5-418f-adc9-b6a2e70e1a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66cd9a4da0504e6794819e26aa0a3ddc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:03Z,use_quota=True,user_id='55233319efd340cd927772695c62b0b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Creating volume 1177f083-27b5-418f-adc9-b6a2e70e1a1c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:04 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c 1073741824
Jul 17 04:00:04 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:04 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c 1073741824" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:04 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c
Jul 17 04:00:04 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:05 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Attempting download of 66c8d884-8875-4094-ac2d-947c1bd00aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/66c8d884-8875-4094-ac2d-947c1bd00aa4', 'metadata': {}}])) to volume 1177f083-27b5-418f-adc9-b6a2e70e1a1c. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18c8756-164b-47ff-b5a4-9510669b727f]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66c8d884-8875-4094-ac2d-947c1bd00aa4_6zc2savm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:05 devstack sudo[104880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66c8d884-8875-4094-ac2d-947c1bd00aa4_6zc2savm
Jul 17 04:00:05 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:05 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66c8d884-8875-4094-ac2d-947c1bd00aa4_6zc2savm" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66c8d884-8875-4094-ac2d-947c1bd00aa4_6zc2savm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:05 devstack sudo[104884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66c8d884-8875-4094-ac2d-947c1bd00aa4_6zc2savm
Jul 17 04:00:05 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:05 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66c8d884-8875-4094-ac2d-947c1bd00aa4_6zc2savm" returned: 1 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66c8d884-8875-4094-ac2d-947c1bd00aa4_6zc2savm' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[82593fab-ae84-4d9b-978b-b972578ecd86]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:05 devstack sudo[104888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD
Jul 17 04:00:05 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:06 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD" returned: 0 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:06 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD
Jul 17 04:00:06 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:06 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] 66c8d884-8875-4094-ac2d-947c1bd00aa4 was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:06 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c
Jul 17 04:00:06 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:06 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66c8d884-8875-4094-ac2d-947c1bd00aa4_irxamcc0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 04:00:06 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Converted 0.00 MB image at 0.00 MB/s
Jul 17 04:00:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:06 devstack sudo[104904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c 1G
Jul 17 04:00:06 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:07 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c 1G" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Downloaded image 66c8d884-8875-4094-ac2d-947c1bd00aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/66c8d884-8875-4094-ac2d-947c1bd00aa4', 'metadata': {}}])) to volume 1177f083-27b5-418f-adc9-b6a2e70e1a1c successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Temporary image 66c8d884-8875-4094-ac2d-947c1bd00aa4 for user 55233319efd340cd927772695c62b0b3 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Marking volume 1177f083-27b5-418f-adc9-b6a2e70e1a1c as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Copying metadata from image 66c8d884-8875-4094-ac2d-947c1bd00aa4 to 1177f083-27b5-418f-adc9-b6a2e70e1a1c. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Creating volume glance metadata for volume 1177f083-27b5-418f-adc9-b6a2e70e1a1c backed by image 66c8d884-8875-4094-ac2d-947c1bd00aa4 with: {'image_id': '66c8d884-8875-4094-ac2d-947c1bd00aa4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '580323d180a9ae4d1a04cb2f84a89d89', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde46727-cf61-4521-abdc-a8936dc2b781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c', 'volume_size': 1, 'image_id': '66c8d884-8875-4094-ac2d-947c1bd00aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66c8d884-8875-4094-ac2d-947c1bd00aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '580323d180a9ae4d1a04cb2f84a89d89', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '66cd9a4da0504e6794819e26aa0a3ddc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c95958b2ee7a7ae8cb0580295149777ad41c7b9ef2cc435b48e27e80c44fac4208773e0bff94ef5d52b73687f357923a2e3c939ed88f0a158ff735fe9637baa9', 'id': '66c8d884-8875-4094-ac2d-947c1bd00aa4', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66c8d884-8875-4094-ac2d-947c1bd00aa4/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cfd2180>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4794901c-9bdc-48ad-854f-7fbb5611ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Volume volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c (1177f083-27b5-418f-adc9-b6a2e70e1a1c): created successfully
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4794901c-9bdc-48ad-854f-7fbb5611ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Flow 'volume_create_manager' (986f0ba0-9510-4f69-979d-5ac266c0a07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-233c6da2-a640-4a3d-8adc-46a23e1891cb tempest-VolumeImageDependencyTests-1988714863 None] Created volume successfully.
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Acquiring lock "cinder-1177f083-27b5-418f-adc9-b6a2e70e1a1c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Lock "cinder-1177f083-27b5-418f-adc9-b6a2e70e1a1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Acquiring lock "cinder-quobyte-1177f083-27b5-418f-adc9-b6a2e70e1a1c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Lock "cinder-quobyte-1177f083-27b5-418f-adc9-b6a2e70e1a1c" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[29479fdd-e4ae-437d-b6f3-d0d89b025adb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:08 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c
Jul 17 04:00:08 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:08 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:08 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c
Jul 17 04:00:08 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:08 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1177f083-27b5-418f-adc9-b6a2e70e1a1c" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Lock "cinder-quobyte-1177f083-27b5-418f-adc9-b6a2e70e1a1c" released by "delete_volume" :: held 0.626s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Created reservations ['07bdbc7f-d099-471c-9006-730d57159fd2', '62e91206-4a06-4aee-8436-3a6d0af7fbbb', '2588e73b-76ce-4c98-ab1a-6d3d04c17665', 'e5880e03-22c2-4a3d-b9d7-f2884993415f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:08 devstack sudo[104918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:08 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:08 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Deleted volume successfully.
Jul 17 04:00:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-de1929c5-04d8-4a2f-9807-b19829315c4c tempest-VolumeImageDependencyTests-1988714863 None] Lock "cinder-1177f083-27b5-418f-adc9-b6a2e70e1a1c-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:12 devstack sudo[104923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:12 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (979f8826-cfcb-4ce2-85a1-05407f7fe7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23ed8ea-29dc-4f06-b404-cd16193606ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23ed8ea-29dc-4f06-b404-cd16193606ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78245275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76edec93-daa2-4f72-9acd-be0a34c76e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:12Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9ad731-d264-4860-90e7-793a77e784da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9ad731-d264-4860-90e7-793a77e784da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55652e00-68c3-4a6b-89c5-7cf40a199992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55652e00-68c3-4a6b-89c5-7cf40a199992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76edec93-daa2-4f72-9acd-be0a34c76e95', 'volume_name': 'volume-76edec93-daa2-4f72-9acd-be0a34c76e95', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e442f49-04ae-4eb5-b205-284ca5099479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:12 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e442f49-04ae-4eb5-b205-284ca5099479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d3202a-d9cd-4078-a875-0dac07fc2b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Volume 76edec93-daa2-4f72-9acd-be0a34c76e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76edec93-daa2-4f72-9acd-be0a34c76e95', 'volume_size': 1}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78245275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76edec93-daa2-4f72-9acd-be0a34c76e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:12Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Creating volume 76edec93-daa2-4f72-9acd-be0a34c76e95 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:12 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 04:00:12 devstack sudo[104926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95 1073741824
Jul 17 04:00:12 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:12 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95 1073741824" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:12 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95
Jul 17 04:00:12 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:13 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d3202a-d9cd-4078-a875-0dac07fc2b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76edec93-daa2-4f72-9acd-be0a34c76e95', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea587445-d38a-4a70-a2f8-851be272076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Volume volume-76edec93-daa2-4f72-9acd-be0a34c76e95 (76edec93-daa2-4f72-9acd-be0a34c76e95): created successfully
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea587445-d38a-4a70-a2f8-851be272076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (979f8826-cfcb-4ce2-85a1-05407f7fe7f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-123bbaaf-486a-4500-b307-f0c101a42f94 tempest-ProjectReaderTests-1831637968 None] Created volume successfully.
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-76edec93-daa2-4f72-9acd-be0a34c76e95-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-76edec93-daa2-4f72-9acd-be0a34c76e95-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-quobyte-76edec93-daa2-4f72-9acd-be0a34c76e95" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-76edec93-daa2-4f72-9acd-be0a34c76e95" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7dfddb-aa88-4664-81eb-f9c8ba935425]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:13 devstack sudo[104935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95
Jul 17 04:00:13 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:14 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:14 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95
Jul 17 04:00:14 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:14 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-76edec93-daa2-4f72-9acd-be0a34c76e95" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-76edec93-daa2-4f72-9acd-be0a34c76e95" released by "delete_volume" :: held 0.628s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Created reservations ['8ce2c834-0a50-4835-930b-693cff11edd9', 'af15e230-f084-42c8-a2ae-d2747d596bd5', 'f41e9b12-d9bf-4c8d-9a20-a86ad37dd421', '7d0e0c48-418a-4be7-ba8b-beef181249f5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:14 devstack sudo[104943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:14 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:14 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Deleted volume successfully.
Jul 17 04:00:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c1728f76-f188-4079-92bb-dabb972309a1 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-76edec93-daa2-4f72-9acd-be0a34c76e95-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (a9db4e7d-5e0a-4d75-93c6-5050748606c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9763e699-ac00-4fc6-8418-6f5881ef1c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9763e699-ac00-4fc6-8418-6f5881ef1c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162656616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1709d0c7-0e39-4d44-8604-2e10ed07a9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:15Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d691d8b4-f9ef-414b-93df-1ac874cecf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d691d8b4-f9ef-414b-93df-1ac874cecf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fd63c3-3ebb-44a9-8efe-60c5c1e95c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fd63c3-3ebb-44a9-8efe-60c5c1e95c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1709d0c7-0e39-4d44-8604-2e10ed07a9e5', 'volume_name': 'volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15db2987-9c62-4a0b-bc56-bdc43aa1cfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15db2987-9c62-4a0b-bc56-bdc43aa1cfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7606a0b-0a1e-48d1-81c6-8d592b75d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Volume 1709d0c7-0e39-4d44-8604-2e10ed07a9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5', 'volume_size': 1}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162656616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1709d0c7-0e39-4d44-8604-2e10ed07a9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:15Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Creating volume 1709d0c7-0e39-4d44-8604-2e10ed07a9e5 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:15 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5 1073741824
Jul 17 04:00:15 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:15 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5 1073741824" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:15 devstack sudo[104951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5
Jul 17 04:00:15 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:15 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7606a0b-0a1e-48d1-81c6-8d592b75d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57414d19-fe2b-4a00-bd76-1de10575c351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Volume volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5 (1709d0c7-0e39-4d44-8604-2e10ed07a9e5): created successfully
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57414d19-fe2b-4a00-bd76-1de10575c351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (a9db4e7d-5e0a-4d75-93c6-5050748606c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-87207975-0831-4d84-ab39-28962aac2703 tempest-ProjectReaderTests-1831637968 None] Created volume successfully.
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-1709d0c7-0e39-4d44-8604-2e10ed07a9e5-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-1709d0c7-0e39-4d44-8604-2e10ed07a9e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-quobyte-1709d0c7-0e39-4d44-8604-2e10ed07a9e5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-1709d0c7-0e39-4d44-8604-2e10ed07a9e5" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c69e7-73b1-486d-bb6b-d68ad8a03f1b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:16 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5
Jul 17 04:00:16 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:16 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:16 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5
Jul 17 04:00:16 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:16 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1709d0c7-0e39-4d44-8604-2e10ed07a9e5" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-1709d0c7-0e39-4d44-8604-2e10ed07a9e5" released by "delete_volume" :: held 0.618s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Created reservations ['665d48ff-4278-4f06-83de-5a6dbf468310', '3c8c62eb-cb88-4e91-9858-14a5eeb41f3e', 'ee99b949-eaac-422c-b2ae-296c370fcea0', 'd004d335-bf9f-40c3-bfcb-17ba0fb1d0cb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:17 devstack sudo[104963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:17 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:17 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Deleted volume successfully.
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8a41db48-077b-4886-b94e-c0043fa742c4 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-1709d0c7-0e39-4d44-8604-2e10ed07a9e5-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (6c64d701-316a-4586-b424-d642a2397a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0936b69c-dbf5-4f48-9b69-c0983abd622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0936b69c-dbf5-4f48-9b69-c0983abd622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529798579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c90689f-b162-4722-b431-e91dd8cbc5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:18Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448c1337-9d8d-4096-8035-086f3205b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448c1337-9d8d-4096-8035-086f3205b980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2435c3-61bd-4cef-b404-4638728d9a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2435c3-61bd-4cef-b404-4638728d9a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c90689f-b162-4722-b431-e91dd8cbc5c0', 'volume_name': 'volume-9c90689f-b162-4722-b431-e91dd8cbc5c0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebfa7aa-d6a7-43c4-a760-70814af37a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebfa7aa-d6a7-43c4-a760-70814af37a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3522fd9c-1f08-4c39-8d81-f1ec3bd85d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Volume 9c90689f-b162-4722-b431-e91dd8cbc5c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c90689f-b162-4722-b431-e91dd8cbc5c0', 'volume_size': 1}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529798579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c90689f-b162-4722-b431-e91dd8cbc5c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:18Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Creating volume 9c90689f-b162-4722-b431-e91dd8cbc5c0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:17 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:17 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0 1073741824
Jul 17 04:00:17 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:18 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0 1073741824" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:18 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0
Jul 17 04:00:18 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:18 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3522fd9c-1f08-4c39-8d81-f1ec3bd85d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c90689f-b162-4722-b431-e91dd8cbc5c0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa448244-d201-4957-9d08-55ad2b416699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Volume volume-9c90689f-b162-4722-b431-e91dd8cbc5c0 (9c90689f-b162-4722-b431-e91dd8cbc5c0): created successfully
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa448244-d201-4957-9d08-55ad2b416699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (6c64d701-316a-4586-b424-d642a2397a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8aa1801-aeb9-4d17-a21f-c70e7919b847 tempest-ProjectReaderTests-1831637968 None] Created volume successfully.
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-9c90689f-b162-4722-b431-e91dd8cbc5c0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-9c90689f-b162-4722-b431-e91dd8cbc5c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-quobyte-9c90689f-b162-4722-b431-e91dd8cbc5c0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-9c90689f-b162-4722-b431-e91dd8cbc5c0" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[041cea5a-4ba5-4ca6-af39-34bcdd789bec]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:18 devstack sudo[104974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0
Jul 17 04:00:18 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:19 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:19 devstack sudo[104979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0
Jul 17 04:00:19 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:19 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9c90689f-b162-4722-b431-e91dd8cbc5c0" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-9c90689f-b162-4722-b431-e91dd8cbc5c0" released by "delete_volume" :: held 0.629s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Created reservations ['549d20c2-4b52-4d8b-8b2d-9318a481a99c', '41f7f2f6-d4c9-4499-b075-4e33a755fafb', 'febfa6f8-3a2e-4d41-9239-1c04ecd88e74', '417c289f-764d-407c-b9e7-9d54e3432940'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:19 devstack sudo[104982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:19 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:19 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Deleted volume successfully.
Jul 17 04:00:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f71fe3c-a002-49f2-9f30-57be03a5ac54 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-9c90689f-b162-4722-b431-e91dd8cbc5c0-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (890a9e55-0a5a-4d96-8275-d964ea990f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b619ca83-68f6-4b4f-846d-51a37ddfbb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b619ca83-68f6-4b4f-846d-51a37ddfbb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025661563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086307a8-333b-4310-b286-07091a3d69ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:20Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5db799-e8fc-477e-ace1-59cebae943af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5db799-e8fc-477e-ace1-59cebae943af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4bdfe1-e00a-4846-8993-b3a61c199227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4bdfe1-e00a-4846-8993-b3a61c199227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086307a8-333b-4310-b286-07091a3d69ce', 'volume_name': 'volume-086307a8-333b-4310-b286-07091a3d69ce', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28593f0-7362-42b4-94d5-36f849d57731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28593f0-7362-42b4-94d5-36f849d57731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d166cab-f72d-46b0-b8cb-5a451e221c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Volume 086307a8-333b-4310-b286-07091a3d69ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086307a8-333b-4310-b286-07091a3d69ce', 'volume_size': 1}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025661563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086307a8-333b-4310-b286-07091a3d69ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a651bd0d7348f08f74d1532e112cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:20Z,use_quota=True,user_id='3dc6d8a3033342b1b6aae9c0f8ab7bc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Creating volume 086307a8-333b-4310-b286-07091a3d69ce {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:20 devstack sudo[104985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce 1073741824
Jul 17 04:00:20 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:20 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce 1073741824" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:20 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce
Jul 17 04:00:20 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:21 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d166cab-f72d-46b0-b8cb-5a451e221c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086307a8-333b-4310-b286-07091a3d69ce', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a394ef3-bc3b-426e-91ec-44172e15fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Volume volume-086307a8-333b-4310-b286-07091a3d69ce (086307a8-333b-4310-b286-07091a3d69ce): created successfully
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a394ef3-bc3b-426e-91ec-44172e15fd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Flow 'volume_create_manager' (890a9e55-0a5a-4d96-8275-d964ea990f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5cb46f97-a8e6-4eb2-8584-eb25e3932f8e tempest-ProjectReaderTests-1831637968 None] Created volume successfully.
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-086307a8-333b-4310-b286-07091a3d69ce-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-086307a8-333b-4310-b286-07091a3d69ce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "cinder-quobyte-086307a8-333b-4310-b286-07091a3d69ce" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-086307a8-333b-4310-b286-07091a3d69ce" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b73a7d6-fe2a-4cb6-9b0f-b04f986020c1]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:21 devstack sudo[104994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce
Jul 17 04:00:21 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:21 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:21 devstack sudo[104999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce
Jul 17 04:00:21 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:22 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-086307a8-333b-4310-b286-07091a3d69ce" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-quobyte-086307a8-333b-4310-b286-07091a3d69ce" released by "delete_volume" :: held 0.613s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Created reservations ['94aeb252-4b24-45b1-b2e1-01ca3ece4951', '0d946c22-4599-4c4d-a3a6-eae08ad39198', 'eabffce8-7d58-4721-aa46-cf8b61a7cb87', '0eba45b9-85db-4b15-848c-bb0a505db15e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:22 devstack sudo[105002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:22 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:22 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Deleted volume successfully.
Jul 17 04:00:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9018e0ea-0099-4c90-8883-89a87e83e597 tempest-ProjectReaderTests-1831637968 None] Lock "cinder-086307a8-333b-4310-b286-07091a3d69ce-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:32 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=51,cinder:UPDATE=69,cinder:INSERT=21,cinder:DELETE=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 04:00:32 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=70,cinder:SELECT=57,cinder:INSERT=28,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (5fb02253-573b-4791-80c5-2600a3c404f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4694f2d-d3ae-4fb2-8de4-e6f40450e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4694f2d-d3ae-4fb2-8de4-e6f40450e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324137078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db83316-c1ad-43f4-a543-9d1890c4bf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:34Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d5c8b9-47b2-497b-beb3-e39b2a1cf0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d5c8b9-47b2-497b-beb3-e39b2a1cf0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c360c6d-c91e-4fec-8462-c1a606a551a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c360c6d-c91e-4fec-8462-c1a606a551a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db83316-c1ad-43f4-a543-9d1890c4bf98', 'volume_name': 'volume-8db83316-c1ad-43f4-a543-9d1890c4bf98', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d82463d-db71-487e-b66f-28aa3da3a843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d82463d-db71-487e-b66f-28aa3da3a843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaa810b-54b7-486d-885e-bf5067c614fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Volume 8db83316-c1ad-43f4-a543-9d1890c4bf98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db83316-c1ad-43f4-a543-9d1890c4bf98', 'volume_size': 1}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-324137078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db83316-c1ad-43f4-a543-9d1890c4bf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:34Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Creating volume 8db83316-c1ad-43f4-a543-9d1890c4bf98 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:34 devstack sudo[105042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98 1073741824
Jul 17 04:00:34 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (7be4ddec-0424-4072-a5ef-6c84a98ed45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fc9474-8a98-4705-ac43-c9dc5857e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fc9474-8a98-4705-ac43-c9dc5857e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-60388315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23d2513-9f7b-460c-b1d7-8da0e9f5f92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:34Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6732738-6791-44a0-8975-2b91eff3eee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6732738-6791-44a0-8975-2b91eff3eee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093a4c90-9900-475f-bea9-769a288d49c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093a4c90-9900-475f-bea9-769a288d49c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a23d2513-9f7b-460c-b1d7-8da0e9f5f92e', 'volume_name': 'volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afea9d0d-8133-48a8-9bf7-f08ba9ed4a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afea9d0d-8133-48a8-9bf7-f08ba9ed4a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da8c1e2-9493-4310-92a3-f991e115a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume a23d2513-9f7b-460c-b1d7-8da0e9f5f92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e', 'volume_size': 1}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:34 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98 1073741824" returned: 0 in 0.744s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (01059dab-b9bd-4562-9513-b2e0074ce32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e480a4c3-505e-4737-b949-9c96054c98a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e480a4c3-505e-4737-b949-9c96054c98a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87019603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244c79f8-d448-41b0-a81f-893a47864b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:35Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e445180f-fa4d-4955-8584-23888420738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e445180f-fa4d-4955-8584-23888420738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e034c6-7b85-48b0-b3c7-4ea950c2712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e034c6-7b85-48b0-b3c7-4ea950c2712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244c79f8-d448-41b0-a81f-893a47864b55', 'volume_name': 'volume-244c79f8-d448-41b0-a81f-893a47864b55', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack sudo[105048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a448e6b2-1bdd-4c70-8da2-ff096b0ea0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a448e6b2-1bdd-4c70-8da2-ff096b0ea0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5711b9bd-1a1b-41de-b7d9-3649b41a7130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Volume 244c79f8-d448-41b0-a81f-893a47864b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244c79f8-d448-41b0-a81f-893a47864b55', 'volume_size': 1}
Jul 17 04:00:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (f9e09869-ee95-4636-800d-d3c866010a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351ba1a8-f354-46dc-a551-eb5562612dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (351ba1a8-f354-46dc-a551-eb5562612dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983591935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff2a3be-f3b8-4089-b1ca-3995ead40350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:35Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a15a3fd-67d1-4dd3-9956-1f1df6bf5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a15a3fd-67d1-4dd3-9956-1f1df6bf5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49911e4c-a7ab-4e02-b013-c7d7fbdaec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49911e4c-a7ab-4e02-b013-c7d7fbdaec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff2a3be-f3b8-4089-b1ca-3995ead40350', 'volume_name': 'volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba9634a-a115-4a8c-b549-8a12b2f6f42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba9634a-a115-4a8c-b549-8a12b2f6f42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f447007-c872-460c-972c-b8b4dc219ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Volume 9ff2a3be-f3b8-4089-b1ca-3995ead40350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350', 'volume_size': 1}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:35 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-60388315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a23d2513-9f7b-460c-b1d7-8da0e9f5f92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:34Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Creating volume a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbaa810b-54b7-486d-885e-bf5067c614fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db83316-c1ad-43f4-a543-9d1890c4bf98', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dd8ee1-f154-437a-a2b2-a718d7d03c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack sudo[105053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e 1073741824
Jul 17 04:00:35 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Volume volume-8db83316-c1ad-43f4-a543-9d1890c4bf98 (8db83316-c1ad-43f4-a543-9d1890c4bf98): created successfully
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dd8ee1-f154-437a-a2b2-a718d7d03c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (5fb02253-573b-4791-80c5-2600a3c404f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ae7344ba-2f13-4491-86b0-99747e51edce tempest-CreateVolumesFromImageTest-1733739696 None] Created volume successfully.
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (8affddee-4b76-4399-a58d-1ad408a4f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8704d5d0-450d-46f1-b8b3-3daef0add77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8704d5d0-450d-46f1-b8b3-3daef0add77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466857759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f3bb67-dfbd-48fc-a9a2-736de7821a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:36Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa2452f-d2dc-4925-b709-ca2880414758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa2452f-d2dc-4925-b709-ca2880414758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa2df76-3cd6-495a-ad1c-6d2f07b8879e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa2df76-3cd6-495a-ad1c-6d2f07b8879e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f3bb67-dfbd-48fc-a9a2-736de7821a89', 'volume_name': 'volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ee3653-e79b-4c59-88d1-39c71472848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ee3653-e79b-4c59-88d1-39c71472848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25123e4e-85d2-44d3-b5aa-d71c82721145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Volume f2f3bb67-dfbd-48fc-a9a2-736de7821a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89', 'volume_size': 1}
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:35 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e 1073741824" returned: 0 in 0.630s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:36 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e
Jul 17 04:00:36 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:36 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (66ae060f-3053-4204-b255-6e7a6a5d4a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9666459-8f72-4e85-bf45-7a5170813f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87019603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244c79f8-d448-41b0-a81f-893a47864b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:35Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Creating volume 244c79f8-d448-41b0-a81f-893a47864b55 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9666459-8f72-4e85-bf45-7a5170813f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1552621372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e88165-cb4b-4753-a341-144fe73338a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:36Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64704e42-3537-47d8-8857-b9df34a00a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:36 devstack sudo[105063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55 1073741824
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64704e42-3537-47d8-8857-b9df34a00a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:36 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c363d9-ca4e-4dc0-b9c0-41aee844c544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c363d9-ca4e-4dc0-b9c0-41aee844c544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e88165-cb4b-4753-a341-144fe73338a3', 'volume_name': 'volume-41e88165-cb4b-4753-a341-144fe73338a3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2119bb-9bec-4531-a076-48b34792fc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b2119bb-9bec-4531-a076-48b34792fc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73193e7b-1251-4b2b-8d2b-b928f191e3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Volume 41e88165-cb4b-4753-a341-144fe73338a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e88165-cb4b-4753-a341-144fe73338a3', 'volume_size': 1}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da8c1e2-9493-4310-92a3-f991e115a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef77659a-c476-42dc-a1ec-6c1af52d1761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e (a23d2513-9f7b-460c-b1d7-8da0e9f5f92e): created successfully
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef77659a-c476-42dc-a1ec-6c1af52d1761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (7be4ddec-0424-4072-a5ef-6c84a98ed45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c1847304-69ba-410b-842c-73350f7b5469 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created volume successfully.
Jul 17 04:00:37 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55 1073741824" returned: 0 in 0.529s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:37 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55
Jul 17 04:00:37 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:37 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Flow 'volume_create_manager' (436b0f80-986a-4003-934d-d4e977bcb519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f5a77a-c1b8-4e03-b4e8-0e4647238708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-983591935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff2a3be-f3b8-4089-b1ca-3995ead40350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:35Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Creating volume 9ff2a3be-f3b8-4089-b1ca-3995ead40350 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95f5a77a-c1b8-4e03-b4e8-0e4647238708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf834e89-552f-441e-a0de-dbfe2291af52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ad8e1f39ff47229e277f45341383c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:37Z,use_quota=True,user_id='cb32dad7129643c4980d5fbc05f58813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3122f55-6e9b-47d3-9a49-ec045be850e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3122f55-6e9b-47d3-9a49-ec045be850e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:37 devstack sudo[105072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350 1073741824
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a700a449-58f6-46c2-a996-85cb307e5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 04:00:37 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5711b9bd-1a1b-41de-b7d9-3649b41a7130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244c79f8-d448-41b0-a81f-893a47864b55', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e503902b-5a78-4796-a311-24f0dd1b5a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Volume volume-244c79f8-d448-41b0-a81f-893a47864b55 (244c79f8-d448-41b0-a81f-893a47864b55): created successfully
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e503902b-5a78-4796-a311-24f0dd1b5a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (01059dab-b9bd-4562-9513-b2e0074ce32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dd71b7c0-96f3-43f2-923d-c31b1aa6a51d tempest-CreateVolumesFromImageTest-1733739696 None] Created volume successfully.
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a700a449-58f6-46c2-a996-85cb307e5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf834e89-552f-441e-a0de-dbfe2291af52', 'volume_name': 'volume-cf834e89-552f-441e-a0de-dbfe2291af52', 'volume_size': 1, 'image_id': '02eaad15-b495-4518-a450-40f03534ffa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02eaad15-b495-4518-a450-40f03534ffa6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0459070d2379706dd90a94cfff892d90', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd8ad8e1f39ff47229e277f45341383c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6ed66fb090b2a32a28496b8f5e9e432d78c5fd07740a1a8fbe40119ae5e65ff25b4de7edaf890095ffdede3dd6d7fdf9508abf2f38e54f43a3a2cf8c912bfe8', 'id': '02eaad15-b495-4518-a450-40f03534ffa6', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02eaad15-b495-4518-a450-40f03534ffa6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ccc1850>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed954d5-1102-42e1-9e8c-7be13067698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed954d5-1102-42e1-9e8c-7be13067698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be328a74-efe5-4339-88a8-372f3029ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Volume cf834e89-552f-441e-a0de-dbfe2291af52: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf834e89-552f-441e-a0de-dbfe2291af52', 'volume_size': 1, 'image_id': '02eaad15-b495-4518-a450-40f03534ffa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02eaad15-b495-4518-a450-40f03534ffa6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0459070d2379706dd90a94cfff892d90', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd8ad8e1f39ff47229e277f45341383c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6ed66fb090b2a32a28496b8f5e9e432d78c5fd07740a1a8fbe40119ae5e65ff25b4de7edaf890095ffdede3dd6d7fdf9508abf2f38e54f43a3a2cf8c912bfe8', 'id': '02eaad15-b495-4518-a450-40f03534ffa6', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02eaad15-b495-4518-a450-40f03534ffa6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ccc1850>}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Trying to clone cf834e89-552f-441e-a0de-dbfe2291af52 from image 02eaad15-b495-4518-a450-40f03534ffa6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02eaad15-b495-4518-a450-40f03534ffa6', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:37 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 04:00:37 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Image download 0.00 MB at 0.00 MB/s
Jul 17 04:00:37 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350 1073741824" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5debf18-6c9c-45de-af6c-46944f0584af]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:38 devstack sudo[105079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350
Jul 17 04:00:38 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:38 devstack sudo[105078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD
Jul 17 04:00:38 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:38 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.428s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466857759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f3bb67-dfbd-48fc-a9a2-736de7821a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:36Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Creating volume f2f3bb67-dfbd-48fc-a9a2-736de7821a89 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f447007-c872-460c-972c-b8b4dc219ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b167cf-ed26-49cb-b111-b518bad05ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:38 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:38 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89 1073741824
Jul 17 04:00:38 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Volume volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350 (9ff2a3be-f3b8-4089-b1ca-3995ead40350): created successfully
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79b167cf-ed26-49cb-b111-b518bad05ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (f9e09869-ee95-4636-800d-d3c866010a00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-76912221-526d-4d50-b8eb-966fb50a98ce tempest-CreateVolumesFromImageTest-1733739696 None] Created volume successfully.
Jul 17 04:00:38 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD
Jul 17 04:00:38 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Flow 'volume_create_manager' (a08620db-7122-4927-a69c-0dd695429728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436f3fda-20e9-4be5-92cb-089886a7ca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436f3fda-20e9-4be5-92cb-089886a7ca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03426cc95ebc4751ad5a2d1ff64b356b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:39Z,use_quota=True,user_id='0e4cd13f12d84d87a15b1d719851240b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(858189bd-05fb-4eee-a786-de5a102875c6),volume_type_id=858189bd-05fb-4eee-a786-de5a102875c6)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869b76be-f4e2-4e60-add4-7d6f3758b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869b76be-f4e2-4e60-add4-7d6f3758b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4361a810-8435-4759-bc8a-0e9324a7c849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 17 04:00:38 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD" returned: 1 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Temporary image 02eaad15-b495-4518-a450-40f03534ffa6 is fetched for user cb32dad7129643c4980d5fbc05f58813. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 04:00:38 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89 1073741824" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ed7acb-695c-4e8d-8b6c-3393f4c7b689]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:39 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89
Jul 17 04:00:39 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4361a810-8435-4759-bc8a-0e9324a7c849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7', 'volume_name': 'volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7', 'volume_size': 1, 'image_id': '167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36b1d9d1c7535e946b1d82c5404f314e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03426cc95ebc4751ad5a2d1ff64b356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '19c2e594e8a3557f8c0e9e2d40ec63e8a475c4af20b8bfd8b49639b2b0be6d4a5823f02183db7e98b690a6dcba1b73d749a2bdf798f23bd9ee787abe2d989093', 'id': '167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf9fc80>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725a37e3-aee8-4667-bfe0-b02a9ec70a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725a37e3-aee8-4667-bfe0-b02a9ec70a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31326e5d-ff11-4cc4-bad6-193dc6358050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:39 devstack sudo[105096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD
Jul 17 04:00:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Volume b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7', 'volume_size': 1, 'image_id': '167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36b1d9d1c7535e946b1d82c5404f314e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03426cc95ebc4751ad5a2d1ff64b356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '19c2e594e8a3557f8c0e9e2d40ec63e8a475c4af20b8bfd8b49639b2b0be6d4a5823f02183db7e98b690a6dcba1b73d749a2bdf798f23bd9ee787abe2d989093', 'id': '167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf9fc80>}
Jul 17 04:00:39 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Trying to clone b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 from image 167efc61-e5c3-4dc6-9a05-0876e0709d7a at location (None, [{'url': 'file:///opt/stack/data/glance/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 17 04:00:39 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Image download 0.00 MB at 0.00 MB/s
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef8fe1e-3df3-4793-a64f-3b69487dd32e]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:39 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.718s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1552621372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e88165-cb4b-4753-a341-144fe73338a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8565d5243a0b4232af3e15fbf7232798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:36Z,use_quota=True,user_id='6ac030551b6f4fb3a037d5a72fc52ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Creating volume 41e88165-cb4b-4753-a341-144fe73338a3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:39 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25123e4e-85d2-44d3-b5aa-d71c82721145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61641acd-6a03-4724-8327-c316601ad1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:39 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3 1073741824
Jul 17 04:00:39 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Volume volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89 (f2f3bb67-dfbd-48fc-a9a2-736de7821a89): created successfully
Jul 17 04:00:39 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61641acd-6a03-4724-8327-c316601ad1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (8affddee-4b76-4399-a58d-1ad408a4f413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:39 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD
Jul 17 04:00:39 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a32bb6a1-a5f0-45cc-a1b5-513f76b69fd3 tempest-CreateVolumesFromImageTest-1733739696 None] Created volume successfully.
Jul 17 04:00:39 devstack sudo[105106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD
Jul 17 04:00:39 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:39 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:39 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:39 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD
Jul 17 04:00:39 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:39 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3 1073741824" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:39 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3
Jul 17 04:00:39 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:40 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Temporary image 167efc61-e5c3-4dc6-9a05-0876e0709d7a is fetched for user 0e4cd13f12d84d87a15b1d719851240b. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d285958-6629-44b3-81de-b98d04062b3d]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:40 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.243s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73193e7b-1251-4b2b-8d2b-b928f191e3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e88165-cb4b-4753-a341-144fe73338a3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c07fd7-4a42-48b4-9be3-36797e306dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Creating offline snapshot 35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 of volume a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:00:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Volume volume-41e88165-cb4b-4753-a341-144fe73338a3 (41e88165-cb4b-4753-a341-144fe73338a3): created successfully
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c07fd7-4a42-48b4-9be3-36797e306dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Flow 'volume_create_manager' (66ae060f-3053-4204-b255-6e7a6a5d4a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54ba7dd-a4b2-418a-b257-101fa484c334]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d158b3ec-5868-4954-8276-52d54046a632 tempest-CreateVolumesFromImageTest-1733739696 None] Created volume successfully.
Jul 17 04:00:40 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD
Jul 17 04:00:40 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:40 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e
Jul 17 04:00:40 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:40 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:40 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:40 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 1G
Jul 17 04:00:40 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:40 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD
Jul 17 04:00:40 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:40 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:40 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 1G" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:40 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51
Jul 17 04:00:40 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-41e88165-cb4b-4753-a341-144fe73338a3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-41e88165-cb4b-4753-a341-144fe73338a3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-quobyte-41e88165-cb4b-4753-a341-144fe73338a3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-41e88165-cb4b-4753-a341-144fe73338a3" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf2b59a-6219-4fbb-bf8a-abcfaa5377a6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:41 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 is being set with open permissions: ugo+rw
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:41 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51
Jul 17 04:00:41 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:41 devstack sudo[105186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3
Jul 17 04:00:41 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:41 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" returned: 0 in 0.257s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:41 devstack sudo[105194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.info
Jul 17 04:00:41 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:41 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:41 devstack sudo[105196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3
Jul 17 04:00:41 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:41 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.info" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.info is being set with open permissions: ugo+rw
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:41 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.info
Jul 17 04:00:41 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:41 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41e88165-cb4b-4753-a341-144fe73338a3" returned: 0 in 0.261s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-41e88165-cb4b-4753-a341-144fe73338a3" released by "delete_volume" :: held 0.671s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Created reservations ['3e3103b7-ff06-41ed-b1c9-9876085d75ab', '4adaa3dc-3e12-4f40-bb33-6cecd0fb4236', '175fe01c-9bff-4c27-a544-1aeeebff94f5', '7f61393e-df20-4e57-b3a8-5cdf5e927226'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:42 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:42 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:42 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.info" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.387s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf834e89-552f-441e-a0de-dbfe2291af52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ad8e1f39ff47229e277f45341383c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:37Z,use_quota=True,user_id='cb32dad7129643c4980d5fbc05f58813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Creating volume cf834e89-552f-441e-a0de-dbfe2291af52 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:42 devstack sudo[105205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 1073741824
Jul 17 04:00:42 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fbc11220-6b1c-4b44-946b-8a990fdb6e92 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Create snapshot completed successfully
Jul 17 04:00:42 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Deleted volume successfully.
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0853aa7c-3d86-4fea-993b-9f50ee9553c1 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-41e88165-cb4b-4753-a341-144fe73338a3-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-f2f3bb67-dfbd-48fc-a9a2-736de7821a89-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-f2f3bb67-dfbd-48fc-a9a2-736de7821a89-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-quobyte-f2f3bb67-dfbd-48fc-a9a2-736de7821a89" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-f2f3bb67-dfbd-48fc-a9a2-736de7821a89" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9a2ef3-97cf-4d89-b97f-9db18cb025bb]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:42 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89
Jul 17 04:00:42 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:42 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 1073741824" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:42 devstack sudo[105214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52
Jul 17 04:00:42 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:42 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:42 devstack sudo[105219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89
Jul 17 04:00:42 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:42 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.052s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03426cc95ebc4751ad5a2d1ff64b356b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:39Z,use_quota=True,user_id='0e4cd13f12d84d87a15b1d719851240b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(858189bd-05fb-4eee-a786-de5a102875c6),volume_type_id=858189bd-05fb-4eee-a786-de5a102875c6)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Creating volume b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:42 devstack sudo[105222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 1073741824
Jul 17 04:00:42 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Attempting download of 02eaad15-b495-4518-a450-40f03534ffa6 ((None, [{'url': 'file:///opt/stack/data/glance/images/02eaad15-b495-4518-a450-40f03534ffa6', 'metadata': {}}])) to volume cf834e89-552f-441e-a0de-dbfe2291af52. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbe8dc4-d500-4295-b05e-cda57b427c48]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02eaad15-b495-4518-a450-40f03534ffa6_k3pme90r {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:43 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f2f3bb67-dfbd-48fc-a9a2-736de7821a89" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:43 devstack sudo[105224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02eaad15-b495-4518-a450-40f03534ffa6_k3pme90r
Jul 17 04:00:43 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-f2f3bb67-dfbd-48fc-a9a2-736de7821a89" released by "delete_volume" :: held 0.703s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Created reservations ['5ad5fbb6-4b4d-4031-b9ab-3d25ee44fcf2', 'f5066b1d-c67a-44e3-a98b-2bbec74f0d44', '55a45266-4e3d-4928-94b3-0528f7634409', '4041be5d-c4e3-4733-a67f-01771e85c8a3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:43 devstack sudo[105231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:43 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:43 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02eaad15-b495-4518-a450-40f03534ffa6_k3pme90r" returned: 0 in 0.438s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02eaad15-b495-4518-a450-40f03534ffa6_k3pme90r {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:43 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 1073741824" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:43 devstack sudo[105236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7
Jul 17 04:00:43 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:43 devstack sudo[105235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02eaad15-b495-4518-a450-40f03534ffa6_k3pme90r
Jul 17 04:00:43 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-9ff2a3be-f3b8-4089-b1ca-3995ead40350-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:43 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-9ff2a3be-f3b8-4089-b1ca-3995ead40350-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (abc9f65e-7430-46f6-a35d-097470d3385f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2112e47f-983d-4c2e-919f-a6fd390b6afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.518s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2112e47f-983d-4c2e-919f-a6fd390b6afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396186900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da566c1-d169-4093-a288-f66f1854ab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:44Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5229a605-883c-44ca-95b1-ee87b5ad4bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5229a605-883c-44ca-95b1-ee87b5ad4bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f883dec4-7dca-462a-86c8-111b9f663030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f883dec4-7dca-462a-86c8-111b9f663030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da566c1-d169-4093-a288-f66f1854ab31', 'volume_name': 'volume-0da566c1-d169-4093-a288-f66f1854ab31', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b46b13-82e4-48ec-8aa1-5edaa7d256eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8b46b13-82e4-48ec-8aa1-5edaa7d256eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ec93da-8b32-456f-b9f9-1d5f8f10c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume 0da566c1-d169-4093-a288-f66f1854ab31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da566c1-d169-4093-a288-f66f1854ab31', 'volume_size': 1}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Deleted volume successfully.
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2d97adc9-3fa0-4b4a-9ebf-7cb662126fd2 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-f2f3bb67-dfbd-48fc-a9a2-736de7821a89-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-quobyte-9ff2a3be-f3b8-4089-b1ca-3995ead40350" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:43 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-9ff2a3be-f3b8-4089-b1ca-3995ead40350" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:43 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396186900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da566c1-d169-4093-a288-f66f1854ab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:44Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Creating volume 0da566c1-d169-4093-a288-f66f1854ab31 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:43 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e983bbe8-5140-4d67-ac4e-3a6ceec11ffd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31 1073741824
Jul 17 04:00:44 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02eaad15-b495-4518-a450-40f03534ffa6_k3pme90r" returned: 1 in 0.634s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02eaad15-b495-4518-a450-40f03534ffa6_k3pme90r' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54e6f7b-7f1b-47ab-910e-6aaffe656f08]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Attempting download of 167efc61-e5c3-4dc6-9a05-0876e0709d7a ((None, [{'url': 'file:///opt/stack/data/glance/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'metadata': {}}])) to volume b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 17 04:00:44 devstack sudo[105245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350
Jul 17 04:00:44 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac85d0-beb0-47ee-910d-7e866c9fab54]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_167efc61-e5c3-4dc6-9a05-0876e0709d7a_6du4xfjr {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack sudo[105246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD
Jul 17 04:00:44 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:44 devstack sudo[105248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_167efc61-e5c3-4dc6-9a05-0876e0709d7a_6du4xfjr
Jul 17 04:00:44 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (f591c8a5-065d-4a8c-8641-25a5cb8e4f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a901ccd0-5470-4de4-89dd-5c0b301832da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a901ccd0-5470-4de4-89dd-5c0b301832da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846770308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56264093-6d0d-46e2-962f-b9d406b92e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:44Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefb4fee-e3e4-49de-9a4a-7d5610ce70db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefb4fee-e3e4-49de-9a4a-7d5610ce70db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:44 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9badff-a2a3-4897-99ad-d81bed3fc8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9badff-a2a3-4897-99ad-d81bed3fc8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56264093-6d0d-46e2-962f-b9d406b92e59', 'volume_name': 'volume-56264093-6d0d-46e2-962f-b9d406b92e59', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a456d4e3-1d9f-467d-8725-dc3c723b218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a456d4e3-1d9f-467d-8725-dc3c723b218c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:44 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ec6e2e-2912-4d51-8fd9-9b3984cff7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume 56264093-6d0d-46e2-962f-b9d406b92e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56264093-6d0d-46e2-962f-b9d406b92e59', 'volume_size': 1}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350" returned: 0 in 0.609s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:44 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350
Jul 17 04:00:44 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31 1073741824" returned: 0 in 0.683s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:44 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_167efc61-e5c3-4dc6-9a05-0876e0709d7a_6du4xfjr" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_167efc61-e5c3-4dc6-9a05-0876e0709d7a_6du4xfjr {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:44 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31
Jul 17 04:00:44 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:44 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD
Jul 17 04:00:44 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:44 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_167efc61-e5c3-4dc6-9a05-0876e0709d7a_6du4xfjr
Jul 17 04:00:44 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (d8779cfa-5d26-4274-9644-b92060f3b1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f474f0-9ecc-4c3e-9e50-768105b1b02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6f474f0-9ecc-4c3e-9e50-768105b1b02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008612348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448e4965-a03a-435d-8c29-99da10d3505d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:45Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52611375-286c-4de3-a206-0a449d0ac8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52611375-286c-4de3-a206-0a449d0ac8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:45 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:45 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8560ff24-4ab8-4221-a106-2bd3f99a5b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8560ff24-4ab8-4221-a106-2bd3f99a5b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448e4965-a03a-435d-8c29-99da10d3505d', 'volume_name': 'volume-448e4965-a03a-435d-8c29-99da10d3505d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0b8c14-28e0-485d-8a2b-fe98b660456b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0b8c14-28e0-485d-8a2b-fe98b660456b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eb6c91-c968-4a1e-b7b3-60a401b80a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume 448e4965-a03a-435d-8c29-99da10d3505d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448e4965-a03a-435d-8c29-99da10d3505d', 'volume_size': 1}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9ff2a3be-f3b8-4089-b1ca-3995ead40350" returned: 0 in 0.598s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:45 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-846770308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56264093-6d0d-46e2-962f-b9d406b92e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:44Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Creating volume 56264093-6d0d-46e2-962f-b9d406b92e59 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:45 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD" returned: 1 in 0.675s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] 02eaad15-b495-4518-a450-40f03534ffa6 was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:45 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59 1073741824
Jul 17 04:00:45 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-9ff2a3be-f3b8-4089-b1ca-3995ead40350" released by "delete_volume" :: held 1.366s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_167efc61-e5c3-4dc6-9a05-0876e0709d7a_6du4xfjr" returned: 1 in 0.640s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_167efc61-e5c3-4dc6-9a05-0876e0709d7a_6du4xfjr' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6662cf4f-7b28-4d79-90d0-7b09986410a3]: (4, 'raw') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ec93da-8b32-456f-b9f9-1d5f8f10c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da566c1-d169-4093-a288-f66f1854ab31', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84db2357-0cf7-458b-8208-d928b948ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:45 devstack sudo[105278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52
Jul 17 04:00:45 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume volume-0da566c1-d169-4093-a288-f66f1854ab31 (0da566c1-d169-4093-a288-f66f1854ab31): created successfully
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84db2357-0cf7-458b-8208-d928b948ab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (abc9f65e-7430-46f6-a35d-097470d3385f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3cc3587c-76e3-4049-a354-7ebf7398362c tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created volume successfully.
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Created reservations ['c54ca294-7e83-48b6-8d00-0e44eec62241', '42b385dc-155d-4d76-a103-93cebc5395c5', '1dd8a63c-7702-420f-b653-9b73df95c193', '1687ae14-ce08-4199-ad64-74a1be3ef8ab'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (45a58ffa-e3a0-4685-b126-4137b79603cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d22f2e-7cf0-4f00-83f3-191e5e6dba8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d22f2e-7cf0-4f00-83f3-191e5e6dba8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893578521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67cec02-c934-4e3d-8ed3-1f2f39e68942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:45Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b923e1-c58d-40c2-990c-3f31b6aa033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b923e1-c58d-40c2-990c-3f31b6aa033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dfbb56-9894-492e-adba-69b0ea45cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1dfbb56-9894-492e-adba-69b0ea45cf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd67cec02-c934-4e3d-8ed3-1f2f39e68942', 'volume_name': 'volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD
Jul 17 04:00:45 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65eb03b-c101-47ac-ad6f-8f6ace99eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65eb03b-c101-47ac-ad6f-8f6ace99eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6424fa37-2878-4651-907b-16f6a4a63c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume d67cec02-c934-4e3d-8ed3-1f2f39e68942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942', 'volume_size': 1}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:45 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:45 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:45 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:45 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59 1073741824" returned: 0 in 0.714s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52" returned: 0 in 0.698s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02eaad15-b495-4518-a450-40f03534ffa6_f7y_yzjedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 04:00:45 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Converted 0.00 MB image at 0.00 MB/s
Jul 17 04:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:46 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:46 devstack sudo[105296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 1G
Jul 17 04:00:46 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:46 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.467s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Deleted volume successfully.
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (8b46344e-c152-40c9-906f-85ae4d3b61c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f316f63-9f98-436b-a607-d4dd66740c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-244c79f8-d448-41b0-a81f-893a47864b55-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:46 devstack sudo[105299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59
Jul 17 04:00:46 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-284b11b5-da67-4784-b12d-4f50c3646a59 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-9ff2a3be-f3b8-4089-b1ca-3995ead40350-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f316f63-9f98-436b-a607-d4dd66740c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898227066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bed3b4-b671-4e26-b883-e3951bf445ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:46Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a021c9-1713-477f-9adb-5c13526bef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a021c9-1713-477f-9adb-5c13526bef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2387c09c-5c1b-4c88-bd73-78ba57aa97d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2387c09c-5c1b-4c88-bd73-78ba57aa97d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39bed3b4-b671-4e26-b883-e3951bf445ee', 'volume_name': 'volume-39bed3b4-b671-4e26-b883-e3951bf445ee', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD
Jul 17 04:00:46 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72407c88-ff7e-49d4-bb1c-2ab8bdd07a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72407c88-ff7e-49d4-bb1c-2ab8bdd07a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369ce2eb-a95d-4638-857b-d461cfbb509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume 39bed3b4-b671-4e26-b883-e3951bf445ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39bed3b4-b671-4e26-b883-e3951bf445ee', 'volume_size': 1}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-244c79f8-d448-41b0-a81f-893a47864b55-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-quobyte-244c79f8-d448-41b0-a81f-893a47864b55" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-244c79f8-d448-41b0-a81f-893a47864b55" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[43adbe9d-2010-43ec-b9b2-2b7dfb24fe12]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:46 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 1G" returned: 0 in 0.459s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Downloaded image 02eaad15-b495-4518-a450-40f03534ffa6 ((None, [{'url': 'file:///opt/stack/data/glance/images/02eaad15-b495-4518-a450-40f03534ffa6', 'metadata': {}}])) to volume cf834e89-552f-441e-a0de-dbfe2291af52 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Temporary image 02eaad15-b495-4518-a450-40f03534ffa6 for user cb32dad7129643c4980d5fbc05f58813 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Marking volume cf834e89-552f-441e-a0de-dbfe2291af52 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Copying metadata from image 02eaad15-b495-4518-a450-40f03534ffa6 to cf834e89-552f-441e-a0de-dbfe2291af52. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Creating volume glance metadata for volume cf834e89-552f-441e-a0de-dbfe2291af52 backed by image 02eaad15-b495-4518-a450-40f03534ffa6 with: {'image_id': '02eaad15-b495-4518-a450-40f03534ffa6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0459070d2379706dd90a94cfff892d90', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 04:00:46 devstack sudo[105307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55
Jul 17 04:00:46 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be328a74-efe5-4339-88a8-372f3029ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf834e89-552f-441e-a0de-dbfe2291af52', 'volume_size': 1, 'image_id': '02eaad15-b495-4518-a450-40f03534ffa6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02eaad15-b495-4518-a450-40f03534ffa6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0459070d2379706dd90a94cfff892d90', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd8ad8e1f39ff47229e277f45341383c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6ed66fb090b2a32a28496b8f5e9e432d78c5fd07740a1a8fbe40119ae5e65ff25b4de7edaf890095ffdede3dd6d7fdf9508abf2f38e54f43a3a2cf8c912bfe8', 'id': '02eaad15-b495-4518-a450-40f03534ffa6', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02eaad15-b495-4518-a450-40f03534ffa6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28ccc1850>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248f7a3-7563-470a-b2bf-abdd2bf1d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:46 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.374s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008612348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448e4965-a03a-435d-8c29-99da10d3505d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:45Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Creating volume 448e4965-a03a-435d-8c29-99da10d3505d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:46 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:46 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Volume volume-cf834e89-552f-441e-a0de-dbfe2291af52 (cf834e89-552f-441e-a0de-dbfe2291af52): created successfully
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1248f7a3-7563-470a-b2bf-abdd2bf1d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack sudo[105313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d 1073741824
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Flow 'volume_create_manager' (436b0f80-986a-4003-934d-d4e977bcb519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:46 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD" returned: 1 in 0.548s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] 167efc61-e5c3-4dc6-9a05-0876e0709d7a was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ec6e2e-2912-4d51-8fd9-9b3984cff7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56264093-6d0d-46e2-962f-b9d406b92e59', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db680977-f08e-4ff6-8bfe-a607905273f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:46 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7
Jul 17 04:00:46 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-80ba447a-adf7-4e30-8ec4-b85ecb0d4597 tempest-VolumeImageDependencyTests-838032511 None] Created volume successfully.
Jul 17 04:00:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume volume-56264093-6d0d-46e2-962f-b9d406b92e59 (56264093-6d0d-46e2-962f-b9d406b92e59): created successfully
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db680977-f08e-4ff6-8bfe-a607905273f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (f591c8a5-065d-4a8c-8641-25a5cb8e4f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f8b9918d-80f7-4534-8346-2ee20fd768c1 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created volume successfully.
Jul 17 04:00:46 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:46 devstack sudo[105322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55
Jul 17 04:00:46 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:47 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d 1073741824" returned: 0 in 0.529s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:47 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7" returned: 0 in 0.523s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_167efc61-e5c3-4dc6-9a05-0876e0709d7a_sxz9jpubdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 04:00:47 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Converted 0.00 MB image at 0.00 MB/s
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:47 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-244c79f8-d448-41b0-a81f-893a47864b55" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:47 devstack sudo[105330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 1G
Jul 17 04:00:47 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-244c79f8-d448-41b0-a81f-893a47864b55" released by "delete_volume" :: held 0.822s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:47 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d
Jul 17 04:00:47 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Acquiring lock "cinder-cf834e89-552f-441e-a0de-dbfe2291af52-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Lock "cinder-cf834e89-552f-441e-a0de-dbfe2291af52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Created reservations ['7cfbbd49-8672-4cce-9a58-6ad656dfaeb4', '0c0306ca-ef85-4f91-a240-96c3e3df113e', 'a854bb90-c4e3-4ba5-a01a-d45e5b84aec1', '869049e8-a673-457d-9228-f801ac0858dd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Acquiring lock "cinder-quobyte-cf834e89-552f-441e-a0de-dbfe2291af52" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Lock "cinder-quobyte-cf834e89-552f-441e-a0de-dbfe2291af52" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e1161c-f2e6-407f-a8d6-5d0a85936bff]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:47 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:47 devstack sudo[105337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:47 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.886s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893578521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67cec02-c934-4e3d-8ed3-1f2f39e68942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:45Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Creating volume d67cec02-c934-4e3d-8ed3-1f2f39e68942 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:47 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52
Jul 17 04:00:47 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eb6c91-c968-4a1e-b7b3-60a401b80a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448e4965-a03a-435d-8c29-99da10d3505d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:47 devstack sudo[105342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942 1073741824
Jul 17 04:00:47 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5403f19-2efe-4aee-8da6-973c59f73db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume volume-448e4965-a03a-435d-8c29-99da10d3505d (448e4965-a03a-435d-8c29-99da10d3505d): created successfully
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5403f19-2efe-4aee-8da6-973c59f73db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (d8779cfa-5d26-4274-9644-b92060f3b1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a47a06c5-e95b-4262-a804-3efc1f305482 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created volume successfully.
Jul 17 04:00:47 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 1G" returned: 0 in 0.492s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Downloaded image 167efc61-e5c3-4dc6-9a05-0876e0709d7a ((None, [{'url': 'file:///opt/stack/data/glance/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'metadata': {}}])) to volume b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Temporary image 167efc61-e5c3-4dc6-9a05-0876e0709d7a for user 0e4cd13f12d84d87a15b1d719851240b is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Marking volume b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Copying metadata from image 167efc61-e5c3-4dc6-9a05-0876e0709d7a to b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Creating volume glance metadata for volume b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 backed by image 167efc61-e5c3-4dc6-9a05-0876e0709d7a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '36b1d9d1c7535e946b1d82c5404f314e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 17 04:00:47 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Deleted volume successfully.
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31326e5d-ff11-4cc4-bad6-193dc6358050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7', 'volume_size': 1, 'image_id': '167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '36b1d9d1c7535e946b1d82c5404f314e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03426cc95ebc4751ad5a2d1ff64b356b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '19c2e594e8a3557f8c0e9e2d40ec63e8a475c4af20b8bfd8b49639b2b0be6d4a5823f02183db7e98b690a6dcba1b73d749a2bdf798f23bd9ee787abe2d989093', 'id': '167efc61-e5c3-4dc6-9a05-0876e0709d7a', 'created_at': datetime.datetime(2026, 7, 17, 2, 0, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 17, 2, 0, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/167efc61-e5c3-4dc6-9a05-0876e0709d7a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x70b28cf9fc80>}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7506d067-5245-4c5f-8584-71dad57341dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Volume volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 (b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7): created successfully
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7506d067-5245-4c5f-8584-71dad57341dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Flow 'volume_create_manager' (a08620db-7122-4927-a69c-0dd695429728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f21e1a89-e384-400c-bc90-f0ab8e34c3f0 tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-244c79f8-d448-41b0-a81f-893a47864b55-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6130b6f7-5177-4395-83c1-b7f644c06d42 tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Created volume successfully.
Jul 17 04:00:47 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:47 devstack sudo[105353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52
Jul 17 04:00:47 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:48 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942 1073741824" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:48 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942
Jul 17 04:00:48 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:48 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-cf834e89-552f-441e-a0de-dbfe2291af52" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Lock "cinder-quobyte-cf834e89-552f-441e-a0de-dbfe2291af52" released by "delete_volume" :: held 0.814s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Created reservations ['7b5e2077-241a-434a-93c1-4a35847a51cf', '19b58d5b-1228-46f0-a79e-85f03d2cf701', '011a8933-1292-4e12-b093-a7b39801e99b', '42e9d596-0e2c-4791-aa2b-0ba18b95a3c1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:48 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:48 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:48 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-898227066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bed3b4-b671-4e26-b883-e3951bf445ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d40484bf1243dfbb042a924cd451c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:46Z,use_quota=True,user_id='58dbd6c5a93c46898859a6b9cd2524ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Creating volume 39bed3b4-b671-4e26-b883-e3951bf445ee {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:48 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6424fa37-2878-4651-907b-16f6a4a63c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c45bdb8-11f6-4fdd-b1fc-a7fee97fda84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:48 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee 1073741824
Jul 17 04:00:48 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942 (d67cec02-c934-4e3d-8ed3-1f2f39e68942): created successfully
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c45bdb8-11f6-4fdd-b1fc-a7fee97fda84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (45a58ffa-e3a0-4685-b126-4137b79603cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Acquiring lock "cinder-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ce87b5fa-7ead-4c23-aad1-3e08ac4fec99 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created volume successfully.
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "cinder-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-8db83316-c1ad-43f4-a543-9d1890c4bf98-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-8db83316-c1ad-43f4-a543-9d1890c4bf98-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Acquiring lock "cinder-quobyte-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:48 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Deleted volume successfully.
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "cinder-quobyte-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "cinder-quobyte-8db83316-c1ad-43f4-a543-9d1890c4bf98" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a128bd69-78c9-4f06-bd95-ee93b0684655]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c193f6be-9b62-486e-a641-5828429a7095 tempest-VolumeImageDependencyTests-838032511 None] Lock "cinder-cf834e89-552f-441e-a0de-dbfe2291af52-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-8db83316-c1ad-43f4-a543-9d1890c4bf98" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2016951c-0ab8-4908-9ebc-b4d97e44eba7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:48 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7
Jul 17 04:00:48 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:48 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98
Jul 17 04:00:48 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:49 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee 1073741824" returned: 0 in 0.719s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:49 devstack sudo[105376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee
Jul 17 04:00:49 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:49 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:49 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:49 devstack sudo[105381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:49 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:49 devstack sudo[105386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98
Jul 17 04:00:49 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:49 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369ce2eb-a95d-4638-857b-d461cfbb509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39bed3b4-b671-4e26-b883-e3951bf445ee', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec6e959-dd86-43c7-b6a9-1547fd52abdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Volume volume-39bed3b4-b671-4e26-b883-e3951bf445ee (39bed3b4-b671-4e26-b883-e3951bf445ee): created successfully
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec6e959-dd86-43c7-b6a9-1547fd52abdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Flow 'volume_create_manager' (8b46344e-c152-40c9-906f-85ae4d3b61c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e72c98b3-c3f1-474d-ad8d-7d23f7116f39 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created volume successfully.
Jul 17 04:00:49 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "cinder-quobyte-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7" released by "delete_volume" :: held 0.869s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:49 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8db83316-c1ad-43f4-a543-9d1890c4bf98" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-quobyte-8db83316-c1ad-43f4-a543-9d1890c4bf98" released by "delete_volume" :: held 0.812s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Created reservations ['ac0efce1-8cb6-4cac-906c-b7c73b3b059c', '830df3eb-9ece-43b2-8718-5ecd9d2b1a6d', 'ccc3f147-bcd6-484a-92f4-d27ca1ce9317', '8a4a10f1-dbbe-4a3a-aedc-19db33b75a05'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Created reservations ['0990756d-6d67-4f4d-8ba8-75a5edeca13b', '8cb383ea-6042-4a6d-9f4e-f1403e003ac9', '869a9dea-ece2-4b7e-b374-3210167991f2', 'd158e77f-f304-485d-ab7d-cbfe8bc95e68'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:49 devstack sudo[105394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:49 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:49 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:49 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:50 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Deleted volume successfully.
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a614b8b5-72ad-4348-a70c-240a3034757e tempest-VolumeAndVolumeTypeFromImageTest-939931760 None] Lock "cinder-b90603ac-8ca3-4c8a-93a6-1bc1f80f7cb7-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:50 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Deleted volume successfully.
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0f10820-585f-48b3-9da5-460f7f02108b tempest-CreateVolumesFromImageTest-1733739696 None] Lock "cinder-8db83316-c1ad-43f4-a543-9d1890c4bf98-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-39bed3b4-b671-4e26-b883-e3951bf445ee-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-39bed3b4-b671-4e26-b883-e3951bf445ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-39bed3b4-b671-4e26-b883-e3951bf445ee" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-39bed3b4-b671-4e26-b883-e3951bf445ee" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e4617-3b66-4dd0-a159-482e20723bb6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:50 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee
Jul 17 04:00:50 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:51 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee" returned: 0 in 0.498s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:51 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee
Jul 17 04:00:51 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:51 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-39bed3b4-b671-4e26-b883-e3951bf445ee" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-39bed3b4-b671-4e26-b883-e3951bf445ee" released by "delete_volume" :: held 0.815s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created reservations ['29760fa9-53d3-4e84-9089-829754bccaf4', '60cc4451-4ae2-4fc1-b086-d9284efc8174', '544c7389-6a32-4926-8f77-cf7c4680e69b', 'ace234e5-aa69-4343-918a-1ad268fcc16f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:51 devstack sudo[105409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:51 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-d67cec02-c934-4e3d-8ed3-1f2f39e68942-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-d67cec02-c934-4e3d-8ed3-1f2f39e68942-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-d67cec02-c934-4e3d-8ed3-1f2f39e68942" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-d67cec02-c934-4e3d-8ed3-1f2f39e68942" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9212fc1-b29c-4e02-a70a-f30206d71b88]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:52 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Deleted volume successfully.
Jul 17 04:00:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68fc7681-9c1a-4113-819a-8c9599908f76 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-39bed3b4-b671-4e26-b883-e3951bf445ee-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:52 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942
Jul 17 04:00:52 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:52 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942" returned: 0 in 0.507s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:52 devstack sudo[105418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942
Jul 17 04:00:52 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:52 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-d67cec02-c934-4e3d-8ed3-1f2f39e68942" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-d67cec02-c934-4e3d-8ed3-1f2f39e68942" released by "delete_volume" :: held 1.057s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created reservations ['fc24869e-98af-4df6-b209-c3a4f2f4fe91', 'e5c1785d-b272-41a6-adba-74b3eb3f26b4', '5bca4f69-ea43-4d8d-8ace-4c34bbf19bdd', '0a7fbe47-361b-4760-bc64-3512e3e60c8c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:53 devstack sudo[105421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:53 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:53 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Deleted volume successfully.
Jul 17 04:00:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7459dd78-4f5c-4d3e-95bd-27659fcbfcb5 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-d67cec02-c934-4e3d-8ed3-1f2f39e68942-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-448e4965-a03a-435d-8c29-99da10d3505d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-448e4965-a03a-435d-8c29-99da10d3505d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-448e4965-a03a-435d-8c29-99da10d3505d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-448e4965-a03a-435d-8c29-99da10d3505d" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc2f5e7-09f6-4eb4-9bba-63e88f2ab61e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:54 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d
Jul 17 04:00:54 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:54 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:54 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d
Jul 17 04:00:54 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:55 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-448e4965-a03a-435d-8c29-99da10d3505d" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-448e4965-a03a-435d-8c29-99da10d3505d" released by "delete_volume" :: held 0.846s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created reservations ['4c5854db-1cab-48d8-813f-cabe57e0eda3', '45db3455-a321-49f3-8386-7b5c329e8976', '8876868e-f07e-4a98-b11e-7823e80653fa', 'c4aeff95-464e-42a2-8722-938d18b4c47a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:55 devstack sudo[105432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:55 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-56264093-6d0d-46e2-962f-b9d406b92e59-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-56264093-6d0d-46e2-962f-b9d406b92e59-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-56264093-6d0d-46e2-962f-b9d406b92e59" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-56264093-6d0d-46e2-962f-b9d406b92e59" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf0aa22-8569-4e36-8bb6-d84e317c2cea]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:55 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Deleted volume successfully.
Jul 17 04:00:55 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59
Jul 17 04:00:55 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6e7c232a-0a66-4d65-a0f7-407167c1c8dd tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-448e4965-a03a-435d-8c29-99da10d3505d-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:56 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59" returned: 0 in 0.534s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:56 devstack sudo[105440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59
Jul 17 04:00:56 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:56 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-56264093-6d0d-46e2-962f-b9d406b92e59" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-56264093-6d0d-46e2-962f-b9d406b92e59" released by "delete_volume" :: held 0.917s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created reservations ['38f67260-db01-4195-a500-334361faed52', '4ddd75e0-33db-48ea-bce5-bdbc587a8eae', 'ad634113-3e00-4f95-ba7b-c222b7a6ddb2', '888fea2a-ed9b-4378-ac00-a00444335435'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:56 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:56 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-0da566c1-d169-4093-a288-f66f1854ab31-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-0da566c1-d169-4093-a288-f66f1854ab31-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:56 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Deleted volume successfully.
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-0da566c1-d169-4093-a288-f66f1854ab31" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df005c5c-b2f6-4d06-97a3-13be12741898 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-56264093-6d0d-46e2-962f-b9d406b92e59-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-0da566c1-d169-4093-a288-f66f1854ab31" acquired by "delete_volume" :: waited 0.049s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4b9ff9-c273-43cd-876b-860701d4659c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:57 devstack sudo[105447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31
Jul 17 04:00:57 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Flow 'volume_create_manager' (fbe189b1-f9b0-4d53-8261-94e65a14928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58f532b-fbfc-4926-b727-ca2e89ff4905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58f532b-fbfc-4926-b727-ca2e89ff4905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1331969232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c7c40-1aaf-4278-b3c9-208da994b373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bfc9b5765f467abed42031e0e31ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:57Z,use_quota=True,user_id='a61f71b7efc34ce2bfd7183e8d47203e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcbf112-70fa-42eb-a7c8-e4ec9e450f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcbf112-70fa-42eb-a7c8-e4ec9e450f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d190310f-92d3-4d11-be6b-e94569e5e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d190310f-92d3-4d11-be6b-e94569e5e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675c7c40-1aaf-4278-b3c9-208da994b373', 'volume_name': 'volume-675c7c40-1aaf-4278-b3c9-208da994b373', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4449d78b-dad7-4721-bbb3-3807539ad1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4449d78b-dad7-4721-bbb3-3807539ad1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a673c22d-1241-4552-9c50-0322fd43f88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Volume 675c7c40-1aaf-4278-b3c9-208da994b373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675c7c40-1aaf-4278-b3c9-208da994b373', 'volume_size': 1}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1331969232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c7c40-1aaf-4278-b3c9-208da994b373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bfc9b5765f467abed42031e0e31ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:00:57Z,use_quota=True,user_id='a61f71b7efc34ce2bfd7183e8d47203e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Creating volume 675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:00:57 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:57 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 1073741824
Jul 17 04:00:57 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:57 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:57 devstack sudo[105454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31
Jul 17 04:00:57 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:57 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-0da566c1-d169-4093-a288-f66f1854ab31" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-0da566c1-d169-4093-a288-f66f1854ab31" released by "delete_volume" :: held 0.809s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created reservations ['ffd80e6a-0a39-4b61-8bb5-e7633d2487ee', 'fa1c9ab8-2c2c-42e4-bfba-0cf1f2d9477c', 'b627beea-c7d5-43d0-8f4b-f1ec0dbe3ddc', 'b53c85c8-987f-4526-8929-9ca3621fa206'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:57 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:00:57 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:58 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 1073741824" returned: 0 in 0.590s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-35fb0297-889b-43b2-a4d8-ff5fd9a3cb51-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-35fb0297-889b-43b2-a4d8-ff5fd9a3cb51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:58 devstack sudo[105463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373
Jul 17 04:00:58 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Deleting offline snapshot 35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 of volume a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] snapshot_file for this snap is: volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[08152d50-2560-4c0d-bd01-c9f36102260a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:58 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:00:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Deleted volume successfully.
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8df9fd66-db59-41b8-85ce-4e5fe3cd1df7 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-0da566c1-d169-4093-a288-f66f1854ab31-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:00:58 devstack sudo[105465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51
Jul 17 04:00:58 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:58 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a673c22d-1241-4552-9c50-0322fd43f88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675c7c40-1aaf-4278-b3c9-208da994b373', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c986f07-b362-40d0-ba85-2a70eb9004ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:00:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Volume volume-675c7c40-1aaf-4278-b3c9-208da994b373 (675c7c40-1aaf-4278-b3c9-208da994b373): created successfully
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c986f07-b362-40d0-ba85-2a70eb9004ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Flow 'volume_create_manager' (fbe189b1-f9b0-4d53-8261-94e65a14928e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:00:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5a8787ad-dcaf-4560-a7dc-ea8de9ea51c4 tempest-VolumeDependencyTests-930409227 None] Created volume successfully.
Jul 17 04:00:58 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dc93d6-8af0-4e37-adbe-36048125d3f5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:58 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e
Jul 17 04:00:58 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:59 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:59 devstack sudo[105477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51
Jul 17 04:00:59 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Creating offline snapshot f3aa0088-50c8-45ce-9abc-8ffe595b2a6f of volume 675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:00:59 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5009fac2-4875-4afe-8fbc-f5ede5960c3f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:00:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:00:59 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51
Jul 17 04:00:59 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:00:59 devstack sudo[105484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373
Jul 17 04:00:59 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:00 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e.35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-35fb0297-889b-43b2-a4d8-ff5fd9a3cb51" released by "_delete_snapshot" :: held 1.986s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" released by "delete_snapshot" :: held 2.020s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created reservations ['a646c6fa-95d8-4196-820a-15f793970114', '56150e14-72ff-4f9c-a98f-90a4831acbdb', '25507896-0bd4-48dd-b554-dbfbdb2ee0eb', 'cdbdb2aa-d95a-4eb6-a2b9-d3fad6bd678c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Delete snapshot completed successfully.
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-46b5c9f4-aad6-4bb6-88b7-8a74d16ec5f9 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-35fb0297-889b-43b2-a4d8-ff5fd9a3cb51-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:00 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373" returned: 0 in 0.592s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:00 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f 1G
Jul 17 04:01:00 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:00 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f 1G" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c7c40-1aaf-4278-b3c9-208da994b373 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:00 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c7c40-1aaf-4278-b3c9-208da994b373 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f
Jul 17 04:01:00 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:01 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c7c40-1aaf-4278-b3c9-208da994b373 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f is being set with open permissions: ugo+rw
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:01 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f
Jul 17 04:01:01 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "cinder-quobyte-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:01 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[72479beb-804a-408b-b104-7b245835c9b6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:01 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.info
Jul 17 04:01:01 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:01 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e
Jul 17 04:01:01 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:01 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.info" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.info is being set with open permissions: ugo+rw
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:01 devstack sudo[105511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.info
Jul 17 04:01:01 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (c9d24195-fa6d-426f-bedc-366b061b4d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:02 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166e50f7-f76a-45fe-9dcc-e83ed2b7756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166e50f7-f76a-45fe-9dcc-e83ed2b7756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707958550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c4f6d0-084b-4c69-9c05-bde0b30b5a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:02Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:02 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e
Jul 17 04:01:02 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a2c87a-733c-491d-82c8-48ac0937221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a2c87a-733c-491d-82c8-48ac0937221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cafc9a-53ce-4392-95b4-d95152da8daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76cafc9a-53ce-4392-95b4-d95152da8daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c4f6d0-084b-4c69-9c05-bde0b30b5a6c', 'volume_name': 'volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6555f32-d56d-4f83-be31-f3887c8b567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6555f32-d56d-4f83-be31-f3887c8b567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97d71f4-9230-4592-9b87-d798ed312b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Volume 20c4f6d0-084b-4c69-9c05-bde0b30b5a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c', 'volume_size': 1}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:02 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.info" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1707958550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c4f6d0-084b-4c69-9c05-bde0b30b5a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:02Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Creating volume 20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:02 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:02 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c 1073741824
Jul 17 04:01:02 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c1daeeb0-fc70-46ef-893f-29ff956f069b tempest-VolumeDependencyTests-930409227 None] Create snapshot completed successfully
Jul 17 04:01:02 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-quobyte-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e" released by "delete_volume" :: held 0.913s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Created reservations ['0eec515f-bdd0-4006-ab73-907cf86f184c', '6679a1cf-120c-4475-893b-7e08a34f9617', '60cd0076-6062-4de1-9d22-d397ad29d95c', 'eefd82be-1cbe-4c82-9779-e0babb2d45f6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:02 devstack sudo[105525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:02 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:02 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c 1073741824" returned: 0 in 0.539s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:02 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Deleted volume successfully.
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-24073b13-ce52-4b66-b6de-73c9568ca012 tempest-CreateVolumesFromSnapshotTest-1018420600 None] Lock "cinder-a23d2513-9f7b-460c-b1d7-8da0e9f5f92e-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:02 devstack sudo[105531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c
Jul 17 04:01:02 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:03 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97d71f4-9230-4592-9b87-d798ed312b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3dd0b0-f911-4d52-9736-98542dc53088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Volume volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c (20c4f6d0-084b-4c69-9c05-bde0b30b5a6c): created successfully
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3dd0b0-f911-4d52-9736-98542dc53088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (c9d24195-fa6d-426f-bedc-366b061b4d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-226c966a-acee-471a-8969-8bc782085ae7 tempest-ProjectReaderTests-1863749020 None] Created volume successfully.
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Flow 'volume_create_manager' (b2665d1d-2a2c-45a0-b8cb-4e46bfe6eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c657f101-3eb5-4dde-bbe6-a63e3ea304e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c657f101-3eb5-4dde-bbe6-a63e3ea304e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-564484348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012e64f9-2b19-4e0c-a4c6-b1ac052c1679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71bfc9b5765f467abed42031e0e31ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3aa0088-50c8-45ce-9abc-8ffe595b2a6f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:03Z,use_quota=True,user_id='a61f71b7efc34ce2bfd7183e8d47203e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089fea80-d7dc-4cd4-ac4d-459989689c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (089fea80-d7dc-4cd4-ac4d-459989689c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426379b3-6e19-4326-8c07-4b843cb069f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426379b3-6e19-4326-8c07-4b843cb069f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '012e64f9-2b19-4e0c-a4c6-b1ac052c1679', 'volume_name': 'volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679', 'volume_size': 1, 'snapshot_id': 'f3aa0088-50c8-45ce-9abc-8ffe595b2a6f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5719a6b-8d46-4a3f-b47c-faf45847836b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5719a6b-8d46-4a3f-b47c-faf45847836b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b08eeb-bab4-4ca2-9c20-5473ed899d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Volume 012e64f9-2b19-4e0c-a4c6-b1ac052c1679: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679', 'volume_size': 1, 'snapshot_id': 'f3aa0088-50c8-45ce-9abc-8ffe595b2a6f'}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-quobyte-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Creating volume 012e64f9-2b19-4e0c-a4c6-b1ac052c1679 from snapshot f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-quobyte-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] snapshot: f3aa0088-50c8-45ce-9abc-8ffe595b2a6f, volume: 012e64f9-2b19-4e0c-a4c6-b1ac052c1679,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd237f03-a2eb-420e-9509-86a69335aaac]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:03 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f
Jul 17 04:01:03 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:04 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" returned: 0 in 0.705s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c7c40-1aaf-4278-b3c9-208da994b373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd33f18a-2a5a-4ea7-bb02-02d232026b03]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:04 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373
Jul 17 04:01:04 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:04 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 04:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:04 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679
Jul 17 04:01:04 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (27c9605f-464c-43fe-a80f-b3ab15ae20cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899e6e79-e01e-4970-a9eb-8b9362b4aac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (899e6e79-e01e-4970-a9eb-8b9362b4aac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1958335037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e6190e-b2df-4828-9b87-45c4b365e7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:09Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd55f65-81c5-490d-850f-4c6dd9858fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd55f65-81c5-490d-850f-4c6dd9858fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18efbf72-ef33-4d76-b09e-32d8f42708e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18efbf72-ef33-4d76-b09e-32d8f42708e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e6190e-b2df-4828-9b87-45c4b365e7cd', 'volume_name': 'volume-35e6190e-b2df-4828-9b87-45c4b365e7cd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069c136-a92c-41f1-b257-2d2a8487856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b069c136-a92c-41f1-b257-2d2a8487856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608a0625-5b5b-4e15-90b7-0497e3f033cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume 35e6190e-b2df-4828-9b87-45c4b365e7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e6190e-b2df-4828-9b87-45c4b365e7cd', 'volume_size': 1}
Jul 17 04:01:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:10 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" returned: 0 in 5.714s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a267857a-4ce0-4fff-be93-e135a6e06195]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:10 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373
Jul 17 04:01:10 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:11 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373" returned: 0 in 0.532s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 04:01:11 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Converted 1024.00 MB image at 179.18 MB/s
Jul 17 04:01:11 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 is being set with open permissions: ugo+rw
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:11 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679
Jul 17 04:01:11 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:11 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" released by "_copy_volume_from_snapshot" :: held 7.756s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" released by "_create_volume_from_snapshot" :: held 7.793s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.810s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.987s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Creating offline snapshot e5292ee1-337c-4e74-8fd6-cd34750e9d12 of volume 20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b08eeb-bab4-4ca2-9c20-5473ed899d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679', 'volume_size': 1, 'snapshot_id': 'f3aa0088-50c8-45ce-9abc-8ffe595b2a6f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2680c3-fae5-4a7c-8f54-d8eb8b508133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abf1b2d-55de-4343-a93f-57e5271f4a87]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Volume volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 (012e64f9-2b19-4e0c-a4c6-b1ac052c1679): created successfully
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2680c3-fae5-4a7c-8f54-d8eb8b508133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Flow 'volume_create_manager' (b2665d1d-2a2c-45a0-b8cb-4e46bfe6eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d8f1aa97-b92f-41a8-8d21-a349199205f4 tempest-VolumeDependencyTests-930409227 None] Created volume successfully.
Jul 17 04:01:11 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c
Jul 17 04:01:11 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:11 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:11 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 1G
Jul 17 04:01:11 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:12 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 1G" returned: 0 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:12 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:12 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:12 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12
Jul 17 04:01:12 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:12 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Lock "cinder-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-quobyte-675c7c40-1aaf-4278-b3c9-208da994b373" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-675c7c40-1aaf-4278-b3c9-208da994b373" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-quobyte-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:12 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Deleting offline snapshot f3aa0088-50c8-45ce-9abc-8ffe595b2a6f of volume 675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] snapshot_file for this snap is: volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:12 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 is being set with open permissions: ugo+rw
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f70d18-fd31-4221-9853-b3ff4f0cacd4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:12 devstack sudo[105588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12
Jul 17 04:01:12 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:12 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f
Jul 17 04:01:12 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:13 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:13 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.info
Jul 17 04:01:13 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:13 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c7c40-1aaf-4278-b3c9-208da994b373(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9404466-0f22-437d-9aef-2736d06e8b22]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:13 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373
Jul 17 04:01:13 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:13 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.info" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:13 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.info is being set with open permissions: ugo+rw
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:13 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.info
Jul 17 04:01:13 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:13 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:13 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.info" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:13 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f
Jul 17 04:01:13 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.218s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1958335037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e6190e-b2df-4828-9b87-45c4b365e7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:09Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Creating volume 35e6190e-b2df-4828-9b87-45c4b365e7cd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:13 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd 1073741824
Jul 17 04:01:13 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-86fb1781-06f5-4220-960b-2fd7d6af4b69 tempest-ProjectReaderTests-1863749020 None] Create snapshot completed successfully
Jul 17 04:01:14 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:14 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f
Jul 17 04:01:14 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:14 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-e5292ee1-337c-4e74-8fd6-cd34750e9d12-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd 1073741824" returned: 0 in 0.547s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-e5292ee1-337c-4e74-8fd6-cd34750e9d12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-e5292ee1-337c-4e74-8fd6-cd34750e9d12" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-e5292ee1-337c-4e74-8fd6-cd34750e9d12" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Deleting offline snapshot e5292ee1-337c-4e74-8fd6-cd34750e9d12 of volume 20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:01:14 devstack sudo[105622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd
Jul 17 04:01:14 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] snapshot_file for this snap is: volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[210cb7e1-a6b3-453d-9425-ae7e5bb4590d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:14 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373.f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f" released by "_delete_snapshot" :: held 1.910s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-675c7c40-1aaf-4278-b3c9-208da994b373" released by "delete_snapshot" :: held 1.936s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:14 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12
Jul 17 04:01:14 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Created reservations ['1a557bbd-8271-422c-9b23-f690a2b21d21', 'e107af4a-b5a6-4449-a889-7359546eb388', '62f89416-30e9-44a2-b027-57d85c824552', '54d81c54-90aa-479c-ad72-ce662e5fd193'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:14 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608a0625-5b5b-4e15-90b7-0497e3f033cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e6190e-b2df-4828-9b87-45c4b365e7cd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf15f060-d9d4-4d18-9214-5a8372dd3045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume volume-35e6190e-b2df-4828-9b87-45c4b365e7cd (35e6190e-b2df-4828-9b87-45c4b365e7cd): created successfully
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf15f060-d9d4-4d18-9214-5a8372dd3045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (27c9605f-464c-43fe-a80f-b3ab15ae20cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-04d19f68-4e5d-4274-9633-775c92442477 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created volume successfully.
Jul 17 04:01:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Delete snapshot completed successfully.
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3fad4783-475e-4948-bf08-a5c0ec44ea6e tempest-VolumeDependencyTests-930409227 None] Lock "cinder-f3aa0088-50c8-45ce-9abc-8ffe595b2a6f-delete_snapshot" released by "delete_snapshot" :: held 2.199s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:14 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[929db067-c5b4-4a44-978c-76b647543172]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:15 devstack sudo[105631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c
Jul 17 04:01:15 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:15 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:15 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12
Jul 17 04:01:15 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:15 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:15 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12
Jul 17 04:01:15 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-675c7c40-1aaf-4278-b3c9-208da994b373-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-675c7c40-1aaf-4278-b3c9-208da994b373-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-quobyte-675c7c40-1aaf-4278-b3c9-208da994b373" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-675c7c40-1aaf-4278-b3c9-208da994b373" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:16 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c.e5292ee1-337c-4e74-8fd6-cd34750e9d12" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46b0199-e679-4131-8552-e57e464a1cf4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-e5292ee1-337c-4e74-8fd6-cd34750e9d12" released by "_delete_snapshot" :: held 1.638s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" released by "delete_snapshot" :: held 1.688s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Created reservations ['e3d7e749-0628-4d09-a74f-208e786dce3c', '8ac083f3-c82d-4d06-9947-59a21a5fa22d', '686d33d1-5636-4946-a054-d26f80ae7176', 'db4efd20-9b17-47bb-9117-97347b0e9617'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:16 devstack sudo[105644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373
Jul 17 04:01:16 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Delete snapshot completed successfully.
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-45e6a6d1-8c8c-44fe-b8b6-67b7b2853a9b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-e5292ee1-337c-4e74-8fd6-cd34750e9d12-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:16 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:16 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373
Jul 17 04:01:16 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (16649ff1-c64d-40d0-976f-dfd9a35fc9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35694208-37a4-4cba-9507-e81afaa7e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Lock "cinder-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35694208-37a4-4cba-9507-e81afaa7e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916876047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5116d7f0-dbfd-4c05-b480-cb84ce110c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:16Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74fcbf7-14e5-45cd-a774-934dc1fe3286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74fcbf7-14e5-45cd-a774-934dc1fe3286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b605e76-d934-4a8b-9e87-edd89943fb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b605e76-d934-4a8b-9e87-edd89943fb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5116d7f0-dbfd-4c05-b480-cb84ce110c5d', 'volume_name': 'volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f786c3ea-73c0-4278-8fc6-9b689cff1fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f786c3ea-73c0-4278-8fc6-9b689cff1fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02be158c-f9bc-49ec-9e53-63bcad646826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume 5116d7f0-dbfd-4c05-b480-cb84ce110c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d', 'volume_size': 1}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916876047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5116d7f0-dbfd-4c05-b480-cb84ce110c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:16Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Creating volume 5116d7f0-dbfd-4c05-b480-cb84ce110c5d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:16 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:16 devstack sudo[105653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d 1073741824
Jul 17 04:01:16 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:16 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-675c7c40-1aaf-4278-b3c9-208da994b373" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce262424-2932-4562-aca2-f343ba67ec73]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (da8c5bf4-5e95-45a6-9aae-f9a14860dbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ce441e-a888-4587-92a3-54bae3e4024a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-675c7c40-1aaf-4278-b3c9-208da994b373" released by "delete_volume" :: held 1.131s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ce441e-a888-4587-92a3-54bae3e4024a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697832451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14ef151-d104-442e-8444-9c8da00f6caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:17Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9006fd1b-202b-41c7-aaee-cd370c3bef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9006fd1b-202b-41c7-aaee-cd370c3bef3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd05279a-5935-4876-afa7-62b696d73d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd05279a-5935-4876-afa7-62b696d73d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b14ef151-d104-442e-8444-9c8da00f6caf', 'volume_name': 'volume-b14ef151-d104-442e-8444-9c8da00f6caf', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73151de7-fab7-4266-bd85-bdb8e8f44fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73151de7-fab7-4266-bd85-bdb8e8f44fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dab78f-d85b-4b72-8374-8970f1011c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume b14ef151-d104-442e-8444-9c8da00f6caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b14ef151-d104-442e-8444-9c8da00f6caf', 'volume_size': 1}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:17 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c
Jul 17 04:01:17 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Created reservations ['68e92342-8ca2-4a65-83cd-d6efc201f0ff', 'ab2346a0-f953-4f39-8347-4547bf76c937', '5ca442f6-0fa1-4a1f-b04b-04b5b87def64', 'b1c6e4c7-3e61-4610-9d2e-7f4c32b88299'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:17 devstack sudo[105662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:17 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:17 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d 1073741824" returned: 0 in 0.755s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:17 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d
Jul 17 04:01:17 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:17 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:17 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" returned: 0 in 0.744s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Deleted volume successfully.
Jul 17 04:01:17 devstack sudo[105670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c
Jul 17 04:01:17 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (9fde2445-11b6-4115-88a3-bc0723761919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b86acd-f5b8-4581-a2d8-f6dda41dba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b86acd-f5b8-4581-a2d8-f6dda41dba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1163099975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be32b3d-2630-4321-a245-473cbe76cbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:18Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144fecbc-27fe-4076-b32b-3f915ad48a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144fecbc-27fe-4076-b32b-3f915ad48a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf9c8dd-fb55-4296-ba8d-e43ac244db27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf9c8dd-fb55-4296-ba8d-e43ac244db27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be32b3d-2630-4321-a245-473cbe76cbda', 'volume_name': 'volume-7be32b3d-2630-4321-a245-473cbe76cbda', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25633f3b-5886-4453-881a-30c423463455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25633f3b-5886-4453-881a-30c423463455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99667394-5389-4b5a-be09-eda478f1edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume 7be32b3d-2630-4321-a245-473cbe76cbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be32b3d-2630-4321-a245-473cbe76cbda', 'volume_size': 1}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5b97148f-ab7d-47b5-b02d-b6917c229637 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-675c7c40-1aaf-4278-b3c9-208da994b373-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:18 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:18 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d" returned: 0 in 0.539s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1697832451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b14ef151-d104-442e-8444-9c8da00f6caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:17Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Creating volume b14ef151-d104-442e-8444-9c8da00f6caf {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c" released by "delete_volume" :: held 1.275s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02be158c-f9bc-49ec-9e53-63bcad646826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:18 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf 1073741824
Jul 17 04:01:18 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56551f0a-9db7-434e-a34a-17fd0f2779b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d (5116d7f0-dbfd-4c05-b480-cb84ce110c5d): created successfully
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56551f0a-9db7-434e-a34a-17fd0f2779b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (16649ff1-c64d-40d0-976f-dfd9a35fc9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4bfa1c70-cc93-4a1d-9d15-44a9da3bbb95 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created volume successfully.
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Created reservations ['02c93470-d418-4148-bb53-46a7f91e8f43', '9303ed8c-2077-4770-8d01-9f8ac1fca38c', 'fe19b4b2-9bcc-4fdc-99f8-43930524ccfb', '8f3d8376-45d3-49c7-bd46-bce59dd0bce1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (9f0a7451-54c4-4adc-a844-bee327d4c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e10992d-a711-460b-aff0-f9b1baa1d673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e10992d-a711-460b-aff0-f9b1baa1d673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138143926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f53b3f-8589-4be7-bddf-906cf6fdf787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:18Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aa68c7-a548-4ec2-9815-24c81e46ee1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85aa68c7-a548-4ec2-9815-24c81e46ee1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837948d6-ef31-41b3-afe6-470f818fa69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837948d6-ef31-41b3-afe6-470f818fa69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f53b3f-8589-4be7-bddf-906cf6fdf787', 'volume_name': 'volume-00f53b3f-8589-4be7-bddf-906cf6fdf787', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cd6f09-1264-43bb-ae3e-08e5d3829c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cd6f09-1264-43bb-ae3e-08e5d3829c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9e85af-5bfa-4719-bc35-47b2eff9f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume 00f53b3f-8589-4be7-bddf-906cf6fdf787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f53b3f-8589-4be7-bddf-906cf6fdf787', 'volume_size': 1}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-012e64f9-2b19-4e0c-a4c6-b1ac052c1679-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:18 devstack sudo[105679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:18 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-012e64f9-2b19-4e0c-a4c6-b1ac052c1679-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "cinder-quobyte-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" acquired by "delete_volume" :: waited 0.068s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[feea7bf4-bb66-4336-b184-e524370e4bfe]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:18 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (9ee1deb2-5a81-418c-8045-8eec2b683e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7857df-a93e-4d67-ba55-3022ca743625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf 1073741824" returned: 0 in 0.917s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:19 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7857df-a93e-4d67-ba55-3022ca743625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146630360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc07184-6de8-4100-bbc2-85b95da05763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:19Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c83f1b6-f7d2-438b-94f5-9bc8bbd27e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c83f1b6-f7d2-438b-94f5-9bc8bbd27e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c3e9fc-cf0b-4a29-9dc0-d294045e4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c3e9fc-cf0b-4a29-9dc0-d294045e4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc07184-6de8-4100-bbc2-85b95da05763', 'volume_name': 'volume-8bc07184-6de8-4100-bbc2-85b95da05763', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d2e39d-51b3-49a3-b87b-a6ca9810370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d2e39d-51b3-49a3-b87b-a6ca9810370c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b659c34a-9f03-4682-8def-51a4276996af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume 8bc07184-6de8-4100-bbc2-85b95da05763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc07184-6de8-4100-bbc2-85b95da05763', 'volume_size': 1}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:19 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679
Jul 17 04:01:19 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.535s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Deleted volume successfully.
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e8f68db-97fd-4ae0-ab18-878d7c5450cd tempest-ProjectReaderTests-1863749020 None] Lock "cinder-20c4f6d0-084b-4c69-9c05-bde0b30b5a6c-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:19 devstack sudo[105684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf
Jul 17 04:01:19 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:19 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1163099975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be32b3d-2630-4321-a245-473cbe76cbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:18Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Creating volume 7be32b3d-2630-4321-a245-473cbe76cbda {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dab78f-d85b-4b72-8374-8970f1011c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b14ef151-d104-442e-8444-9c8da00f6caf', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14765a4-491a-47de-8029-99c5f3bc5a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda 1073741824
Jul 17 04:01:19 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume volume-b14ef151-d104-442e-8444-9c8da00f6caf (b14ef151-d104-442e-8444-9c8da00f6caf): created successfully
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c14765a4-491a-47de-8029-99c5f3bc5a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (da8c5bf4-5e95-45a6-9aae-f9a14860dbb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4cea18a9-a4f9-4f53-8ba1-f52808066b24 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created volume successfully.
Jul 17 04:01:19 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" returned: 0 in 0.633s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:19 devstack sudo[105693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679
Jul 17 04:01:19 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (886b389b-e9ff-4920-aace-f4c14f6ae151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd54352a-55f5-4e3f-914c-63f5aa8ab7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd54352a-55f5-4e3f-914c-63f5aa8ab7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432235307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa2c7dd-a288-4fe2-bfde-c1c0753351f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:20Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ade875d-d4b8-40e3-b409-42aed89630a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ade875d-d4b8-40e3-b409-42aed89630a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9fee20-e50e-4d43-a770-7b60b0749b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9fee20-e50e-4d43-a770-7b60b0749b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa2c7dd-a288-4fe2-bfde-c1c0753351f1', 'volume_name': 'volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3fd0eb-b89a-4728-a810-317abda962e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3fd0eb-b89a-4728-a810-317abda962e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e353531-5b8c-402e-9095-54e4601d8655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Volume ffa2c7dd-a288-4fe2-bfde-c1c0753351f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1', 'volume_size': 1}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:19 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-quobyte-012e64f9-2b19-4e0c-a4c6-b1ac052c1679" released by "delete_volume" :: held 1.045s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Created reservations ['ecce3b83-3cbf-4bb9-8af2-2eed1f0f3080', '813c6abb-f945-44e5-a4e6-b4e5ec317406', 'db0ac165-86e2-4dbb-be85-8f8657ea18eb', '1b1f095c-cb47-4969-af4f-b4339d3f35e1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:20 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda 1073741824" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:20 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:20 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:20 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda
Jul 17 04:01:20 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:20 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Deleted volume successfully.
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01e0f372-f01d-47be-8960-7da4e8552098 tempest-VolumeDependencyTests-930409227 None] Lock "cinder-012e64f9-2b19-4e0c-a4c6-b1ac052c1679-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:20 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.869s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138143926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f53b3f-8589-4be7-bddf-906cf6fdf787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:18Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Creating volume 00f53b3f-8589-4be7-bddf-906cf6fdf787 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99667394-5389-4b5a-be09-eda478f1edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be32b3d-2630-4321-a245-473cbe76cbda', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332ad563-b57a-4adc-b2a3-3d215b767d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume volume-7be32b3d-2630-4321-a245-473cbe76cbda (7be32b3d-2630-4321-a245-473cbe76cbda): created successfully
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332ad563-b57a-4adc-b2a3-3d215b767d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (9fde2445-11b6-4115-88a3-bc0723761919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:20 devstack sudo[105706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787 1073741824
Jul 17 04:01:20 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-82f786d2-1cee-44f4-b0ec-aa592d65d3ad tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created volume successfully.
Jul 17 04:01:21 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787 1073741824" returned: 0 in 0.585s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:21 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787
Jul 17 04:01:21 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:21 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.223s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-146630360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc07184-6de8-4100-bbc2-85b95da05763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b6bd576a564515aa5ad4cc21124534',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:19Z,use_quota=True,user_id='97a95bb5aa804ce6b2dbcb4505a1c76b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Creating volume 8bc07184-6de8-4100-bbc2-85b95da05763 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9e85af-5bfa-4719-bc35-47b2eff9f724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f53b3f-8589-4be7-bddf-906cf6fdf787', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0736ce66-0535-4018-a817-7b534eb909ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:21 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763 1073741824
Jul 17 04:01:21 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume volume-00f53b3f-8589-4be7-bddf-906cf6fdf787 (00f53b3f-8589-4be7-bddf-906cf6fdf787): created successfully
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0736ce66-0535-4018-a817-7b534eb909ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (9f0a7451-54c4-4adc-a844-bee327d4c66c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-095e894c-f70f-426b-b39c-12cff4449bee tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created volume successfully.
Jul 17 04:01:21 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763 1073741824" returned: 0 in 0.560s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:21 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763
Jul 17 04:01:22 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:22 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.503s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-432235307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa2c7dd-a288-4fe2-bfde-c1c0753351f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:20Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Creating volume ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b659c34a-9f03-4682-8def-51a4276996af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc07184-6de8-4100-bbc2-85b95da05763', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb9052-c859-4c6e-9c79-7cbdbd45c804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:22 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 1073741824
Jul 17 04:01:22 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Volume volume-8bc07184-6de8-4100-bbc2-85b95da05763 (8bc07184-6de8-4100-bbc2-85b95da05763): created successfully
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97eb9052-c859-4c6e-9c79-7cbdbd45c804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Flow 'volume_create_manager' (9ee1deb2-5a81-418c-8045-8eec2b683e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b5a16675-dd5b-4168-bd70-07668bbd2995 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created volume successfully.
Jul 17 04:01:22 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 1073741824" returned: 0 in 0.577s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:23 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1
Jul 17 04:01:23 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:23 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" returned: 0 in 0.298s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e353531-5b8c-402e-9095-54e4601d8655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b663ee-40d4-46a4-88b2-47690eca55ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Volume volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 (ffa2c7dd-a288-4fe2-bfde-c1c0753351f1): created successfully
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b663ee-40d4-46a4-88b2-47690eca55ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (886b389b-e9ff-4920-aace-f4c14f6ae151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9e7bb82b-c856-4195-ac52-19abe58c9109 tempest-ProjectReaderTests-1863749020 None] Created volume successfully.
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-8bc07184-6de8-4100-bbc2-85b95da05763-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-8bc07184-6de8-4100-bbc2-85b95da05763-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-quobyte-8bc07184-6de8-4100-bbc2-85b95da05763" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-8bc07184-6de8-4100-bbc2-85b95da05763" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a6941a-0d5f-4455-b8ff-ec64bc16ab88]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:23 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763
Jul 17 04:01:23 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:24 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763" returned: 0 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:24 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763
Jul 17 04:01:24 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Creating offline snapshot 26f66e31-3eae-4bc6-86fa-72b8f8e9d960 of volume ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[15015b0f-372b-4a30-b06b-66374ca76556]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:24 devstack sudo[105741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1
Jul 17 04:01:24 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:24 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-8bc07184-6de8-4100-bbc2-85b95da05763" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-8bc07184-6de8-4100-bbc2-85b95da05763" released by "delete_volume" :: held 0.890s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created reservations ['e1063f9b-fcf6-45d8-b787-4bd761cfffbf', 'd94d8599-fb4d-4820-a6bb-c1ad18d8f82d', '785ce0e2-768c-4fdb-8ea7-e2599332fc9d', 'bcad19e0-cd62-431c-8d4e-78ebf0f1e39e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:24 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:24 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-00f53b3f-8589-4be7-bddf-906cf6fdf787-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:24 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-00f53b3f-8589-4be7-bddf-906cf6fdf787-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:24 devstack sudo[105749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 1G
Jul 17 04:01:24 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-quobyte-00f53b3f-8589-4be7-bddf-906cf6fdf787" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-00f53b3f-8589-4be7-bddf-906cf6fdf787" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f177ba-4a4d-4727-a9c8-6c894bd69019]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:25 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787
Jul 17 04:01:25 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:25 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.455s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Deleted volume successfully.
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a679f083-2310-40a4-b629-8fa47e645695 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-8bc07184-6de8-4100-bbc2-85b95da05763-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:25 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 1G" returned: 0 in 0.640s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:25 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787" returned: 0 in 0.510s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:25 devstack sudo[105763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960
Jul 17 04:01:25 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:25 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787
Jul 17 04:01:25 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:25 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-00f53b3f-8589-4be7-bddf-906cf6fdf787" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-00f53b3f-8589-4be7-bddf-906cf6fdf787" released by "delete_volume" :: held 0.884s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:25 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:25 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 is being set with open permissions: ugo+rw
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:25 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960
Jul 17 04:01:25 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created reservations ['9cd627bf-5e2d-425d-8e33-54348ce1fcc5', 'fdd9b7d6-5681-44b6-a514-1a6b15c6da3c', '5f217596-4062-445d-b1aa-0a5ee0006262', '5d28bad3-a232-4090-b846-20dc0570aee4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:26 devstack sudo[105774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:26 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:26 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:26 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.info
Jul 17 04:01:26 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:26 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Deleted volume successfully.
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fc8ab12f-fd27-47e2-9f96-be1d3cdc3938 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-00f53b3f-8589-4be7-bddf-906cf6fdf787-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:26 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.info" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:26 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.info is being set with open permissions: ugo+rw
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:26 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.info
Jul 17 04:01:26 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:26 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.info" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-33840ec6-1a22-4cb7-acd4-7a7e60d9e070 tempest-ProjectReaderTests-1863749020 None] Create snapshot completed successfully
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-7be32b3d-2630-4321-a245-473cbe76cbda-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-7be32b3d-2630-4321-a245-473cbe76cbda-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-quobyte-7be32b3d-2630-4321-a245-473cbe76cbda" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-7be32b3d-2630-4321-a245-473cbe76cbda" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955123e-bcbf-48ec-b5fe-065f28385128]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:27 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda
Jul 17 04:01:27 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-26f66e31-3eae-4bc6-86fa-72b8f8e9d960-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-26f66e31-3eae-4bc6-86fa-72b8f8e9d960-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-26f66e31-3eae-4bc6-86fa-72b8f8e9d960" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-26f66e31-3eae-4bc6-86fa-72b8f8e9d960" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Deleting offline snapshot 26f66e31-3eae-4bc6-86fa-72b8f8e9d960 of volume ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] snapshot_file for this snap is: volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4259d48b-06c5-4e0d-9fae-ea4c3121a6e2]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:27 devstack sudo[105787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960
Jul 17 04:01:27 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:27 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda" returned: 0 in 0.620s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:27 devstack sudo[105792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda
Jul 17 04:01:27 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:28 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960" returned: 0 in 0.545s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a4e7f-014e-4f19-bad2-5cabbe9ca14d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:28 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-7be32b3d-2630-4321-a245-473cbe76cbda" returned: 0 in 0.505s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-7be32b3d-2630-4321-a245-473cbe76cbda" released by "delete_volume" :: held 1.176s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:28 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1
Jul 17 04:01:28 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created reservations ['db71a93d-8ac0-4437-8c6f-faad8c949b82', 'be67fcb5-aed9-4974-a776-74344e15775c', 'c5429090-8e54-4686-b7ab-53e40d5f6caa', 'a8c08c59-e619-49bd-992a-0d03ee97079e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:28 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:28 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:28 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" returned: 0 in 0.488s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:28 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960
Jul 17 04:01:28 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:28 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Deleted volume successfully.
Jul 17 04:01:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7d25835d-03af-4693-befa-0a5d752f2fc1 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-7be32b3d-2630-4321-a245-473cbe76cbda-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Flow 'volume_create_manager' (61b27dcd-fb06-464f-928a-e64ee1589a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad70394-a433-417e-9245-6c13046dda3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:29 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad70394-a433-417e-9245-6c13046dda3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-90332101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564b4b26-b29c-41ec-baa8-ac51dd94148c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46cd49ff954b7cbbaca3bb48bac089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:29Z,use_quota=True,user_id='a3331b38784a47a09fbbfc52e36c07ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d756d-7ef6-4a50-830f-e3b4bae7575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d756d-7ef6-4a50-830f-e3b4bae7575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:29 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960
Jul 17 04:01:29 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e93b3-cafc-4983-adad-75c36c4817ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13e93b3-cafc-4983-adad-75c36c4817ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564b4b26-b29c-41ec-baa8-ac51dd94148c', 'volume_name': 'volume-564b4b26-b29c-41ec-baa8-ac51dd94148c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c65b51-ba0e-42a6-9625-ebce0f8cb58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c65b51-ba0e-42a6-9625-ebce0f8cb58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f149bbf8-8088-4d9e-a24b-9ba94e0dffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Volume 564b4b26-b29c-41ec-baa8-ac51dd94148c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564b4b26-b29c-41ec-baa8-ac51dd94148c', 'volume_size': 1}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-90332101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564b4b26-b29c-41ec-baa8-ac51dd94148c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46cd49ff954b7cbbaca3bb48bac089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:29Z,use_quota=True,user_id='a3331b38784a47a09fbbfc52e36c07ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Creating volume 564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-b14ef151-d104-442e-8444-9c8da00f6caf-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:29 devstack sudo[105815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c 1073741824
Jul 17 04:01:29 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-b14ef151-d104-442e-8444-9c8da00f6caf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-quobyte-b14ef151-d104-442e-8444-9c8da00f6caf" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-b14ef151-d104-442e-8444-9c8da00f6caf" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[962bc8de-cb04-40a7-9672-e4e1e7633b5a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:29 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1.26f66e31-3eae-4bc6-86fa-72b8f8e9d960" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-26f66e31-3eae-4bc6-86fa-72b8f8e9d960" released by "_delete_snapshot" :: held 2.071s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" released by "delete_snapshot" :: held 2.108s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:29 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf
Jul 17 04:01:29 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Created reservations ['d432de37-4f57-4222-abdf-e9dbc68dc037', '68811964-0c0a-4f2a-adfc-eca6b8de621f', '2b62d5e2-186e-46ad-91f4-ce9ae98fd31b', 'b923d662-b316-41e5-a3a8-537095ebbe46'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Delete snapshot completed successfully.
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c8cae62-461e-4ec3-b8ea-c1ec3a918c45 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-26f66e31-3eae-4bc6-86fa-72b8f8e9d960-delete_snapshot" released by "delete_snapshot" :: held 2.287s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:29 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c 1073741824" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:29 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c
Jul 17 04:01:29 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:29 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf" returned: 0 in 0.459s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:30 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf
Jul 17 04:01:30 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:30 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f149bbf8-8088-4d9e-a24b-9ba94e0dffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564b4b26-b29c-41ec-baa8-ac51dd94148c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6bff44-68e7-4519-ae57-f04d07e991bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Volume volume-564b4b26-b29c-41ec-baa8-ac51dd94148c (564b4b26-b29c-41ec-baa8-ac51dd94148c): created successfully
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6bff44-68e7-4519-ae57-f04d07e991bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Flow 'volume_create_manager' (61b27dcd-fb06-464f-928a-e64ee1589a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-31582bb2-2610-44a3-aebf-2e00c0a7428d tempest-SnapshotDependencyTests-538305627 None] Created volume successfully.
Jul 17 04:01:30 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b14ef151-d104-442e-8444-9c8da00f6caf" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-b14ef151-d104-442e-8444-9c8da00f6caf" released by "delete_volume" :: held 0.778s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created reservations ['71fac6fe-4ef3-4bb7-9229-74cb1f917ec8', '69e02d48-42e8-48f5-bb0e-0e2c9cd0aedf', 'e495a814-cc81-4c85-ac32-5b97d38456e3', 'fd297123-8265-4fdc-b9b3-193a3bae7ff8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:30 devstack sudo[105833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:30 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-5116d7f0-dbfd-4c05-b480-cb84ce110c5d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-5116d7f0-dbfd-4c05-b480-cb84ce110c5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:30 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-quobyte-5116d7f0-dbfd-4c05-b480-cb84ce110c5d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Deleted volume successfully.
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-5116d7f0-dbfd-4c05-b480-cb84ce110c5d" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61690f92-fa1a-425b-bc0a-d5bfd282f8ce tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-b14ef151-d104-442e-8444-9c8da00f6caf-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd4b3ff-f4d0-4339-bcad-7a160a5cd665]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea1411-e334-4913-8a89-2482dcbafcbc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:30 devstack sudo[105836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d
Jul 17 04:01:30 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:30 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1
Jul 17 04:01:30 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:31 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:31 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d
Jul 17 04:01:31 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:31 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:31 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1
Jul 17 04:01:31 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:31 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-5116d7f0-dbfd-4c05-b480-cb84ce110c5d" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-5116d7f0-dbfd-4c05-b480-cb84ce110c5d" released by "delete_volume" :: held 0.802s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created reservations ['050403a9-5a7e-4af4-ba09-2698f04b269f', '26fce627-2b8d-4a5f-9199-207e249748ce', '40416bb7-951c-423b-b80d-296b54efcf7d', '0f818da2-9920-4218-9316-0726791354ed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:31 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1" released by "delete_volume" :: held 0.932s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Creating offline snapshot f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f of volume 564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-35e6190e-b2df-4828-9b87-45c4b365e7cd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c38d8e-70c4-488b-badd-cab3e7d62538]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:31 devstack sudo[105852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:31 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-35e6190e-b2df-4828-9b87-45c4b365e7cd-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Created reservations ['5880b522-2933-461b-bd88-a7f7b26375ce', 'fb9c642c-b607-44e4-9a75-0d515995665b', 'e51fbe7c-e46c-4657-822b-3f37ebb5fe1f', '9e392582-aabf-4ad1-8b41-df5dbc2d606a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "cinder-quobyte-35e6190e-b2df-4828-9b87-45c4b365e7cd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-35e6190e-b2df-4828-9b87-45c4b365e7cd" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:32 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c
Jul 17 04:01:32 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdb6f9b-f799-4238-baf2-16c78cbc3ef7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:32 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:32 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:32 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Deleted volume successfully.
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e9aff3d8-c9db-4053-90ec-f4998a9a2490 tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-5116d7f0-dbfd-4c05-b480-cb84ce110c5d-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:32 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd
Jul 17 04:01:32 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:32 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:32 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f 1G
Jul 17 04:01:32 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:32 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Deleted volume successfully.
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=218,cinder:UPDATE=276,cinder:INSERT=78,cinder:DELETE=24 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ad379960-095d-4496-b526-f03c7fdee520 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-ffa2c7dd-a288-4fe2-bfde-c1c0753351f1-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:32 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:32 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd
Jul 17 04:01:32 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:32 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f 1G" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564b4b26-b29c-41ec-baa8-ac51dd94148c -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:32 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564b4b26-b29c-41ec-baa8-ac51dd94148c -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f
Jul 17 04:01:32 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:32 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35e6190e-b2df-4828-9b87-45c4b365e7cd" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-quobyte-35e6190e-b2df-4828-9b87-45c4b365e7cd" released by "delete_volume" :: held 0.760s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=191,cinder:UPDATE=282,cinder:DELETE=26,cinder:INSERT=72 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Created reservations ['52dee377-9799-42ac-8ef2-f422ef52bcf7', 'a5adf96d-c781-4cd3-9391-913eeefdb1d4', '2e822465-4b1e-4bbc-9aa6-1ac1dacbf75c', 'a01db245-2779-45e9-8438-fc0f1d5028bf'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:32 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:32 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:33 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-564b4b26-b29c-41ec-baa8-ac51dd94148c -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:33 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f is being set with open permissions: ugo+rw
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:33 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f
Jul 17 04:01:33 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:33 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Deleted volume successfully.
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8d8e5190-b18d-4125-865b-e8df7784a4eb tempest-CreateVolumesFromSourceVolumeTest-639646325 None] Lock "cinder-35e6190e-b2df-4828-9b87-45c4b365e7cd-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:33 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:33 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.info
Jul 17 04:01:33 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (ee36fabd-912a-4728-9cf6-b5641c417b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3e7321-33f1-4e40-a62d-23ffaed1f18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3e7321-33f1-4e40-a62d-23ffaed1f18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165197829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943d9b09-dec5-463d-8030-30a025b371e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:34Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e87429-eb02-4e05-8dce-4babdb701923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e87429-eb02-4e05-8dce-4babdb701923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874e8a76-8500-4ed9-9ceb-c339bddcf1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874e8a76-8500-4ed9-9ceb-c339bddcf1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943d9b09-dec5-463d-8030-30a025b371e3', 'volume_name': 'volume-943d9b09-dec5-463d-8030-30a025b371e3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c4bffe-1664-438a-8e57-380e1257fffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c4bffe-1664-438a-8e57-380e1257fffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:34 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae63db3-e601-4071-a0f3-de2eec87b798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Volume 943d9b09-dec5-463d-8030-30a025b371e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943d9b09-dec5-463d-8030-30a025b371e3', 'volume_size': 1}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.info" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:34 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.info is being set with open permissions: ugo+rw
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:34 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.info
Jul 17 04:01:34 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:34 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.info" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1165197829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943d9b09-dec5-463d-8030-30a025b371e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:34Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Creating volume 943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:34 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:34 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 1073741824
Jul 17 04:01:34 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9904dd5d-1124-4747-9d99-8b9e286e59cb tempest-SnapshotDependencyTests-538305627 None] Create snapshot completed successfully
Jul 17 04:01:34 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 1073741824" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:34 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3
Jul 17 04:01:34 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:35 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae63db3-e601-4071-a0f3-de2eec87b798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943d9b09-dec5-463d-8030-30a025b371e3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc6dc60-6c2c-4180-b019-c4a280c9e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Volume volume-943d9b09-dec5-463d-8030-30a025b371e3 (943d9b09-dec5-463d-8030-30a025b371e3): created successfully
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecc6dc60-6c2c-4180-b019-c4a280c9e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (ee36fabd-912a-4728-9cf6-b5641c417b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6bf3a50f-fdec-4ea3-9031-d585eb6fd045 tempest-ProjectReaderTests-1863749020 None] Created volume successfully.
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Flow 'volume_create_manager' (c5d0a6bf-6207-4932-ae55-042282e3fd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46588134-bf41-4a9e-a706-50d56cc028e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46588134-bf41-4a9e-a706-50d56cc028e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65d47b5-78e5-480d-886f-9a783ef81444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f46cd49ff954b7cbbaca3bb48bac089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:35Z,use_quota=True,user_id='a3331b38784a47a09fbbfc52e36c07ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be9fe9f-bf50-4a38-a187-b642b5b6c12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be9fe9f-bf50-4a38-a187-b642b5b6c12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47132b12-f5d0-4ff5-b682-97dd5c5dc049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47132b12-f5d0-4ff5-b682-97dd5c5dc049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b65d47b5-78e5-480d-886f-9a783ef81444', 'volume_name': 'volume-b65d47b5-78e5-480d-886f-9a783ef81444', 'volume_size': 1, 'snapshot_id': 'f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d49d89f-ed21-491c-a3e5-172c4415051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d49d89f-ed21-491c-a3e5-172c4415051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdf5bd9-0c5c-48c1-989b-6b21607f56e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Volume b65d47b5-78e5-480d-886f-9a783ef81444: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b65d47b5-78e5-480d-886f-9a783ef81444', 'volume_size': 1, 'snapshot_id': 'f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f'}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-quobyte-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f-b65d47b5-78e5-480d-886f-9a783ef81444" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f-b65d47b5-78e5-480d-886f-9a783ef81444" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Creating volume b65d47b5-78e5-480d-886f-9a783ef81444 from snapshot f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-quobyte-b65d47b5-78e5-480d-886f-9a783ef81444" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-b65d47b5-78e5-480d-886f-9a783ef81444" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] snapshot: f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f, volume: b65d47b5-78e5-480d-886f-9a783ef81444,  {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387f1c9-ab9c-423c-bd58-36e3409f47f3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:35 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f
Jul 17 04:01:35 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:36 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-564b4b26-b29c-41ec-baa8-ac51dd94148c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8948f751-7098-433b-af63-8aa0d4ee14d6]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:36 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c
Jul 17 04:01:36 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:36 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Path /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:36 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444
Jul 17 04:01:36 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Flow 'volume_create_manager' (bc0ad8a3-61d2-47fb-8dca-5773e0f7778e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aca5ec8-a4ca-4006-9a62-5bc4a2f8e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aca5ec8-a4ca-4006-9a62-5bc4a2f8e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc3a26a-b178-4db4-87f2-75ac144355a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8922ac7b56e84c93b39cb645e3f025b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:37Z,use_quota=True,user_id='0272e77a584e4e86afa95a144f39cbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8222bf76-6617-4e2f-9ec9-b592403a13cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8222bf76-6617-4e2f-9ec9-b592403a13cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea35222c-bc71-4637-abaf-df7b33e06a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea35222c-bc71-4637-abaf-df7b33e06a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc3a26a-b178-4db4-87f2-75ac144355a5', 'volume_name': 'volume-3cc3a26a-b178-4db4-87f2-75ac144355a5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3bf8e3-922f-4f77-9414-e0dd2e73e9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b3bf8e3-922f-4f77-9414-e0dd2e73e9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0ebd75-90a3-42f0-be7c-4dbba8383f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Volume 3cc3a26a-b178-4db4-87f2-75ac144355a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc3a26a-b178-4db4-87f2-75ac144355a5', 'volume_size': 1}
Jul 17 04:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:41 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444" returned: 0 in 4.990s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6d544d-695b-4cde-b2a2-9f7ac6bbb543]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:41 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c
Jul 17 04:01:41 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:42 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c" returned: 0 in 0.569s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Image conversion details: src /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 17 04:01:42 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Converted 1024.00 MB image at 205.16 MB/s
Jul 17 04:01:42 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444 is being set with open permissions: ugo+rw
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:42 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444
Jul 17 04:01:42 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:42 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-b65d47b5-78e5-480d-886f-9a783ef81444" released by "_copy_volume_from_snapshot" :: held 6.930s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f-b65d47b5-78e5-480d-886f-9a783ef81444" released by "_create_volume_from_snapshot" :: held 6.966s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.989s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.518s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Creating offline snapshot c3e97415-61a6-4306-8f0e-ffffd76671cc of volume 943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdf5bd9-0c5c-48c1-989b-6b21607f56e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65d47b5-78e5-480d-886f-9a783ef81444', 'volume_size': 1, 'snapshot_id': 'f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e6231a-ef80-413b-9d46-ee7407f142f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[39463706-b501-49ce-b68e-4ad30986e0ac]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Volume volume-b65d47b5-78e5-480d-886f-9a783ef81444 (b65d47b5-78e5-480d-886f-9a783ef81444): created successfully
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e6231a-ef80-413b-9d46-ee7407f142f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Flow 'volume_create_manager' (c5d0a6bf-6207-4932-ae55-042282e3fd21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8c8235af-98f6-4dde-8038-3dac29c5b89e tempest-SnapshotDependencyTests-538305627 None] Created volume successfully.
Jul 17 04:01:42 devstack sudo[105971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3
Jul 17 04:01:42 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:43 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3" returned: 0 in 0.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:43 devstack sudo[105976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc 1G
Jul 17 04:01:43 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-quobyte-564b4b26-b29c-41ec-baa8-ac51dd94148c" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-564b4b26-b29c-41ec-baa8-ac51dd94148c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-quobyte-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Deleting offline snapshot f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f of volume 564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] snapshot_file for this snap is: volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa962837-fbe7-47fb-8ea0-98b12835accd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:43 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f
Jul 17 04:01:43 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:43 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc 1G" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943d9b09-dec5-463d-8030-30a025b371e3 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:43 devstack sudo[105984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943d9b09-dec5-463d-8030-30a025b371e3 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc
Jul 17 04:01:43 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:43 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-564b4b26-b29c-41ec-baa8-ac51dd94148c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c901b3-d10e-491d-8bd6-2b9938ff8e8f]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:43 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943d9b09-dec5-463d-8030-30a025b371e3 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:43 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc is being set with open permissions: ugo+rw
Jul 17 04:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:43 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc
Jul 17 04:01:43 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:43 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c
Jul 17 04:01:43 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:44 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:44 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:44 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.info
Jul 17 04:01:44 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:44 devstack sudo[106002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f
Jul 17 04:01:44 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:44 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.info" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:44 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.info is being set with open permissions: ugo+rw
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:44 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.info
Jul 17 04:01:44 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:44 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:44 devstack sudo[106011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f
Jul 17 04:01:44 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:44 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.info" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.890s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc3a26a-b178-4db4-87f2-75ac144355a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8922ac7b56e84c93b39cb645e3f025b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:37Z,use_quota=True,user_id='0272e77a584e4e86afa95a144f39cbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Creating volume 3cc3a26a-b178-4db4-87f2-75ac144355a5 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:44 devstack sudo[106014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5 1073741824
Jul 17 04:01:44 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-11d531b5-e20b-4286-9fe4-72bdaf0a7ae7 tempest-ProjectReaderTests-1863749020 None] Create snapshot completed successfully
Jul 17 04:01:44 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c.f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f" released by "_delete_snapshot" :: held 1.649s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-564b4b26-b29c-41ec-baa8-ac51dd94148c" released by "delete_snapshot" :: held 1.678s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Created reservations ['d95a2061-b7fe-4674-b043-2b52ca52dc6a', '5d60cb87-e779-4b51-84d7-fe4005c05d37', 'c08ab089-2f65-4ca3-b4c5-1e79ee07dbcc', '5b794dd0-b623-477b-8760-014510d76eaa'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Delete snapshot completed successfully.
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54f873c7-8e6e-4d31-845e-26b546bca053 tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-f3c7f7e8-bd24-43d3-be5a-8ca3f0ca8c4f-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:45 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5 1073741824" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:45 devstack sudo[106021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5
Jul 17 04:01:45 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-564b4b26-b29c-41ec-baa8-ac51dd94148c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-564b4b26-b29c-41ec-baa8-ac51dd94148c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-quobyte-564b4b26-b29c-41ec-baa8-ac51dd94148c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-564b4b26-b29c-41ec-baa8-ac51dd94148c" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2351c490-39ba-4b42-90d3-8b7b66eb9966]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:45 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef0ebd75-90a3-42f0-be7c-4dbba8383f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc3a26a-b178-4db4-87f2-75ac144355a5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad90a6c-3176-4699-9742-fcfd9969f0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Volume volume-3cc3a26a-b178-4db4-87f2-75ac144355a5 (3cc3a26a-b178-4db4-87f2-75ac144355a5): created successfully
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad90a6c-3176-4699-9742-fcfd9969f0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Flow 'volume_create_manager' (bc0ad8a3-61d2-47fb-8dca-5773e0f7778e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-c3e97415-61a6-4306-8f0e-ffffd76671cc-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b0303bff-ef90-4b39-afae-b2f4e0725caf tempest-CinderUnicodeTest-1511981255 None] Created volume successfully.
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-c3e97415-61a6-4306-8f0e-ffffd76671cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-943d9b09-dec5-463d-8030-30a025b371e3" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-943d9b09-dec5-463d-8030-30a025b371e3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-c3e97415-61a6-4306-8f0e-ffffd76671cc" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:45 devstack sudo[106024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c
Jul 17 04:01:45 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-c3e97415-61a6-4306-8f0e-ffffd76671cc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Deleting offline snapshot c3e97415-61a6-4306-8f0e-ffffd76671cc of volume 943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] snapshot_file for this snap is: volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[58988d93-0b5a-47f6-ae66-8118bfcc6ae4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:45 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc
Jul 17 04:01:45 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:46 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:46 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c
Jul 17 04:01:46 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:46 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943d9b09-dec5-463d-8030-30a025b371e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2cc3ad-a7f8-440f-a34e-7119e996d2cc]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:46 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-564b4b26-b29c-41ec-baa8-ac51dd94148c" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-564b4b26-b29c-41ec-baa8-ac51dd94148c" released by "delete_volume" :: held 0.801s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Created reservations ['b08a40fc-b018-4f26-9258-8cf55750f46d', '690316fb-a37c-4242-b20d-914e11ffe9b2', 'c15718f5-6614-4b51-a7c0-3fdaad6d076a', 'c6bdf360-d861-4751-88b9-92a146e01e2a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:46 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3
Jul 17 04:01:46 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:46 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:46 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-b65d47b5-78e5-480d-886f-9a783ef81444-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-b65d47b5-78e5-480d-886f-9a783ef81444-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:46 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:46 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "cinder-quobyte-b65d47b5-78e5-480d-886f-9a783ef81444" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Deleted volume successfully.
Jul 17 04:01:46 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc
Jul 17 04:01:46 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-b65d47b5-78e5-480d-886f-9a783ef81444" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db5cec65-5dcc-45a9-a76c-c1861249d70e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-564b4b26-b29c-41ec-baa8-ac51dd94148c-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2643e7b9-b4c5-42f0-81b3-05d519eee60e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:47 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444
Jul 17 04:01:47 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:47 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:47 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc
Jul 17 04:01:47 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:47 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:47 devstack sudo[106060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444
Jul 17 04:01:47 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (d6e07c38-db08-47b1-966d-40a91c6e5ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c302bb4-1365-4f14-894d-aabe3406dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c302bb4-1365-4f14-894d-aabe3406dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952803244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a623b9e5-4ef1-44fd-80a1-6d1585d1abed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:47Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a455c6-0f7d-4963-97db-8fd8fd20f9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a455c6-0f7d-4963-97db-8fd8fd20f9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3c0255-fd69-4da2-8c14-2d62a7101d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3c0255-fd69-4da2-8c14-2d62a7101d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a623b9e5-4ef1-44fd-80a1-6d1585d1abed', 'volume_name': 'volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782ff2b9-77be-46f7-80c8-1d93844eb426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782ff2b9-77be-46f7-80c8-1d93844eb426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223e859f-53b2-48cc-811f-6c5d34fc940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Volume a623b9e5-4ef1-44fd-80a1-6d1585d1abed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed', 'volume_size': 1}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952803244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a623b9e5-4ef1-44fd-80a1-6d1585d1abed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:47Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Creating volume a623b9e5-4ef1-44fd-80a1-6d1585d1abed {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:47 devstack sudo[106062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed 1073741824
Jul 17 04:01:47 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:47 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3.c3e97415-61a6-4306-8f0e-ffffd76671cc" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-c3e97415-61a6-4306-8f0e-ffffd76671cc" released by "_delete_snapshot" :: held 1.769s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-943d9b09-dec5-463d-8030-30a025b371e3" released by "delete_snapshot" :: held 1.802s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Flow 'volume_create_manager' (bda8bc36-c707-418e-9750-9fea70b6f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354739fe-abff-4194-af32-58a3d03fada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-b65d47b5-78e5-480d-886f-9a783ef81444" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354739fe-abff-4194-af32-58a3d03fada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-35904965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e956e937-3e34-4c9e-8422-aa1cb67c0098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8922ac7b56e84c93b39cb645e3f025b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:48Z,use_quota=True,user_id='0272e77a584e4e86afa95a144f39cbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fba943b-44be-47e7-9344-701e0a2db5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fba943b-44be-47e7-9344-701e0a2db5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0342b820-d1b8-46fb-ac8e-d5a8a38d12a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0342b820-d1b8-46fb-ac8e-d5a8a38d12a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e956e937-3e34-4c9e-8422-aa1cb67c0098', 'volume_name': 'volume-e956e937-3e34-4c9e-8422-aa1cb67c0098', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb5dab0-b0c7-4e47-ba46-5b58f52f682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb5dab0-b0c7-4e47-ba46-5b58f52f682f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92a7cf8-b2dc-41ee-a4ef-8bbcec2a8b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Volume e956e937-3e34-4c9e-8422-aa1cb67c0098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e956e937-3e34-4c9e-8422-aa1cb67c0098', 'volume_size': 1}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-quobyte-b65d47b5-78e5-480d-886f-9a783ef81444" released by "delete_volume" :: held 0.914s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Created reservations ['783e363c-ab8c-4772-b369-7845e210ce53', 'c2078fc1-2496-4f59-8499-294c919562a8', 'c3b9f5ec-627a-4e4b-91d2-83ab96e5376f', '0b738f3c-4251-4bf6-b1ae-4919805482e3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Created reservations ['b0891007-97d0-4957-9baf-604ba72c638b', 'd6c78186-5926-4303-8cc3-5ec95bc8ecc6', '9f06d0d9-8d66-43e8-bd3f-4d5c48b0dacf', '3a8ccc6c-044e-4464-9d38-1afa9253e0cb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Delete snapshot completed successfully.
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f3a24cf4-6689-43ac-a837-7334a56b792b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-c3e97415-61a6-4306-8f0e-ffffd76671cc-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:47 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:47 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:48 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed 1073741824" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:48 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed
Jul 17 04:01:48 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-943d9b09-dec5-463d-8030-30a025b371e3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-943d9b09-dec5-463d-8030-30a025b371e3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-943d9b09-dec5-463d-8030-30a025b371e3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-943d9b09-dec5-463d-8030-30a025b371e3" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:48 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Deleted volume successfully.
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ae5e72-822d-4208-b4b9-5ef01cbccf76]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f33ed84c-b178-4eba-8504-7e137828c63e tempest-SnapshotDependencyTests-538305627 None] Lock "cinder-b65d47b5-78e5-480d-886f-9a783ef81444-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:48 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3
Jul 17 04:01:48 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:48 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-35904965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e956e937-3e34-4c9e-8422-aa1cb67c0098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8922ac7b56e84c93b39cb645e3f025b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:48Z,use_quota=True,user_id='0272e77a584e4e86afa95a144f39cbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Creating volume e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:48 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223e859f-53b2-48cc-811f-6c5d34fc940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:48 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 1073741824
Jul 17 04:01:48 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc12661a-5d4a-4949-afab-b454334bc171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Volume volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed (a623b9e5-4ef1-44fd-80a1-6d1585d1abed): created successfully
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc12661a-5d4a-4949-afab-b454334bc171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (d6e07c38-db08-47b1-966d-40a91c6e5ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fb8dcc37-8739-4899-b761-5e125a124b5e tempest-ProjectReaderTests-176154084 None] Created volume successfully.
Jul 17 04:01:48 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:48 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3
Jul 17 04:01:48 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:48 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 1073741824" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:48 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-943d9b09-dec5-463d-8030-30a025b371e3" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-943d9b09-dec5-463d-8030-30a025b371e3" released by "delete_volume" :: held 0.731s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:48 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098
Jul 17 04:01:48 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Created reservations ['efc5146f-3915-43c1-9185-dcc13f55e3b4', '580e51af-6c06-4507-8f54-1f2481914ae5', '8719adeb-a64a-4404-b7c9-c62c0c006e14', '56bf4495-4a53-45ac-b760-c531a2e6d196'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:49 devstack sudo[106091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:49 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:49 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92a7cf8-b2dc-41ee-a4ef-8bbcec2a8b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e956e937-3e34-4c9e-8422-aa1cb67c0098', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2472fec1-980c-43be-988d-fe584b986e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Volume volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 (e956e937-3e34-4c9e-8422-aa1cb67c0098): created successfully
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2472fec1-980c-43be-988d-fe584b986e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Flow 'volume_create_manager' (bda8bc36-c707-418e-9750-9fea70b6f15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1b461bae-2548-496a-9f1c-5a74bddd3ed3 tempest-CinderUnicodeTest-1511981255 None] Created volume successfully.
Jul 17 04:01:49 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Deleted volume successfully.
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-310deeab-7111-41fb-bd2c-4a41fed971a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-943d9b09-dec5-463d-8030-30a025b371e3-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-a623b9e5-4ef1-44fd-80a1-6d1585d1abed-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Lock "cinder-a623b9e5-4ef1-44fd-80a1-6d1585d1abed-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (fb8a9469-f0b8-4abe-a9bf-ece1b6389e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba51b2-9f08-4073-93a8-c2d0605476cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba51b2-9f08-4073-93a8-c2d0605476cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450922209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb25a1d-989f-485b-833f-7fd7a3df88de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:50Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4a653-223c-4780-a1ad-1af45c135227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2e4a653-223c-4780-a1ad-1af45c135227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132e522-18b3-442d-a058-4886e7adb94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b132e522-18b3-442d-a058-4886e7adb94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cb25a1d-989f-485b-833f-7fd7a3df88de', 'volume_name': 'volume-3cb25a1d-989f-485b-833f-7fd7a3df88de', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0d3381-d90e-40f5-b800-41ceca7eb2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb0d3381-d90e-40f5-b800-41ceca7eb2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac11323-e4ee-49eb-86a3-b00c18b8ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Volume 3cb25a1d-989f-485b-833f-7fd7a3df88de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cb25a1d-989f-485b-833f-7fd7a3df88de', 'volume_size': 1}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450922209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb25a1d-989f-485b-833f-7fd7a3df88de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:50Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Creating volume 3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-quobyte-a623b9e5-4ef1-44fd-80a1-6d1585d1abed" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:50 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de 1073741824
Jul 17 04:01:50 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-a623b9e5-4ef1-44fd-80a1-6d1585d1abed" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec9f37-a5db-4a22-9dc3-da9d13866946]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:50 devstack sudo[106103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed
Jul 17 04:01:50 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:50 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:50 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de 1073741824" returned: 0 in 0.567s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:50 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed
Jul 17 04:01:50 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:50 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de
Jul 17 04:01:50 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:50 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a623b9e5-4ef1-44fd-80a1-6d1585d1abed" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-a623b9e5-4ef1-44fd-80a1-6d1585d1abed" released by "delete_volume" :: held 0.799s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:50 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.698s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Created reservations ['11e8ca6d-f02d-4609-834e-fbcdbee717b4', 'ac9171a1-d05c-464b-a301-d2bd0d3a404c', '5a56b62d-bdd5-453d-ab67-48ef3c8ca5a0', '07e97143-6844-47a7-a2fb-1032a1275871'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Creating offline snapshot 85a3a5e9-00b5-4db4-8d27-f7c5095aca80 of volume e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac11323-e4ee-49eb-86a3-b00c18b8ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb25a1d-989f-485b-833f-7fd7a3df88de', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a19d46-1ecc-470f-a39a-57ec1ddc31d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9214fc-5423-41e8-b9df-67c3f3c26220]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Volume volume-3cb25a1d-989f-485b-833f-7fd7a3df88de (3cb25a1d-989f-485b-833f-7fd7a3df88de): created successfully
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a19d46-1ecc-470f-a39a-57ec1ddc31d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (fb8a9469-f0b8-4abe-a9bf-ece1b6389e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3979ce47-eb5c-4aac-874a-516c74f00e72 tempest-ProjectReaderTests-1863749020 None] Created volume successfully.
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:51 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098
Jul 17 04:01:51 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:51 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:51 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:51 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Deleted volume successfully.
Jul 17 04:01:51 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d89a3012-9f4d-4205-92a9-367e57dc1ef6 tempest-ProjectReaderTests-176154084 None] Lock "cinder-a623b9e5-4ef1-44fd-80a1-6d1585d1abed-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:51 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 1G
Jul 17 04:01:51 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:51 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 1G" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:51 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80
Jul 17 04:01:51 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:52 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:52 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 is being set with open permissions: ugo+rw
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:52 devstack sudo[106140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80
Jul 17 04:01:52 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:52 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:52 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.info
Jul 17 04:01:52 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (332e266d-8f24-4dda-aa0e-9520a2a1f9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dda3aa-527e-445c-87eb-1a66d7378e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dda3aa-527e-445c-87eb-1a66d7378e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975384459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec60fe06-b54f-40ed-8efc-a8fdf7888bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:53Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bb2547-36f4-4c82-af9c-cb4bffa1fb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bb2547-36f4-4c82-af9c-cb4bffa1fb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917e7786-041f-446e-957b-92fbcb6bfe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917e7786-041f-446e-957b-92fbcb6bfe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec60fe06-b54f-40ed-8efc-a8fdf7888bbe', 'volume_name': 'volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e51baa6-5674-479c-a4f8-b1a4af659706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e51baa6-5674-479c-a4f8-b1a4af659706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f8ef4b-504c-47f1-9ddd-80e782f58434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Volume ec60fe06-b54f-40ed-8efc-a8fdf7888bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe', 'volume_size': 1}
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:52 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.info" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:52 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.info is being set with open permissions: ugo+rw
Jul 17 04:01:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:52 devstack sudo[106147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.info
Jul 17 04:01:52 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:53 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.info" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.272s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.926s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Creating offline snapshot 06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 of volume 3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:01:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-43dde7ab-7762-41b0-8795-c7310f8613ca tempest-CinderUnicodeTest-1511981255 None] Create snapshot completed successfully
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e585b-d663-4d4d-bfda-d7bb7a7319df]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "cinder-85a3a5e9-00b5-4db4-8d27-f7c5095aca80-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:53 devstack sudo[106150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de
Jul 17 04:01:53 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-85a3a5e9-00b5-4db4-8d27-f7c5095aca80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "cinder-quobyte-e956e937-3e34-4c9e-8422-aa1cb67c0098" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-e956e937-3e34-4c9e-8422-aa1cb67c0098" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "cinder-quobyte-85a3a5e9-00b5-4db4-8d27-f7c5095aca80" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-85a3a5e9-00b5-4db4-8d27-f7c5095aca80" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Deleting offline snapshot 85a3a5e9-00b5-4db4-8d27-f7c5095aca80 of volume e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] snapshot_file for this snap is: volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f25c4-c067-4d43-948a-23e8d0cf10df]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:53 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80
Jul 17 04:01:53 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:53 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:53 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 1G
Jul 17 04:01:53 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:53 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80" returned: 0 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e956e937-3e34-4c9e-8422-aa1cb67c0098(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547f563-a9b9-461a-abe6-37644c19dfbd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:54 devstack sudo[106167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098
Jul 17 04:01:54 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:54 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 1G" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cb25a1d-989f-485b-833f-7fd7a3df88de -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:54 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cb25a1d-989f-485b-833f-7fd7a3df88de -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0
Jul 17 04:01:54 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:54 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:54 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80
Jul 17 04:01:54 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:54 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cb25a1d-989f-485b-833f-7fd7a3df88de -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 is being set with open permissions: ugo+rw
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:54 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0
Jul 17 04:01:54 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:54 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:54 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:54 devstack sudo[106187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80
Jul 17 04:01:54 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:54 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.info
Jul 17 04:01:54 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:55 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098.85a3a5e9-00b5-4db4-8d27-f7c5095aca80" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:55 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-85a3a5e9-00b5-4db4-8d27-f7c5095aca80" released by "_delete_snapshot" :: held 1.650s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.info" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.info is being set with open permissions: ugo+rw
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-e956e937-3e34-4c9e-8422-aa1cb67c0098" released by "delete_snapshot" :: held 1.686s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:55 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.info
Jul 17 04:01:55 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Created reservations ['70e662f5-0960-472c-b462-91fc78e43f30', '5bea5ec0-690b-4d8f-8f3b-e4ed410cfbf1', '4f26aba2-c3b9-4237-a5ce-a9d0fc6ce0fc', '76811e37-060c-42d0-9ed5-0b01d3a7e258'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Delete snapshot completed successfully.
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27b23f0a-92fa-40c7-97ac-4b735f8b4c50 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-85a3a5e9-00b5-4db4-8d27-f7c5095aca80-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:55 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.info" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.640s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1975384459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec60fe06-b54f-40ed-8efc-a8fdf7888bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:01:53Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Creating volume ec60fe06-b54f-40ed-8efc-a8fdf7888bbe {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:55 devstack sudo[106196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe 1073741824
Jul 17 04:01:55 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-126bff8c-f1ea-47f4-a29a-979a592c9c36 tempest-ProjectReaderTests-1863749020 None] Create snapshot completed successfully
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "cinder-e956e937-3e34-4c9e-8422-aa1cb67c0098-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-e956e937-3e34-4c9e-8422-aa1cb67c0098-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "cinder-quobyte-e956e937-3e34-4c9e-8422-aa1cb67c0098" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-e956e937-3e34-4c9e-8422-aa1cb67c0098" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[996e03f8-8871-43f0-9dd0-d740e2a348c7]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:55 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098
Jul 17 04:01:55 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:56 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe 1073741824" returned: 0 in 0.566s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:56 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe
Jul 17 04:01:56 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:56 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:56 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098
Jul 17 04:01:56 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:56 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f8ef4b-504c-47f1-9ddd-80e782f58434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43760652-d3e6-4507-a414-8e409e117de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Volume volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe (ec60fe06-b54f-40ed-8efc-a8fdf7888bbe): created successfully
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43760652-d3e6-4507-a414-8e409e117de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (332e266d-8f24-4dda-aa0e-9520a2a1f9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4ecd376d-285b-4fab-9b2a-03e8a45dcefe tempest-ProjectReaderTests-176154084 None] Created volume successfully.
Jul 17 04:01:56 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-e956e937-3e34-4c9e-8422-aa1cb67c0098" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-e956e937-3e34-4c9e-8422-aa1cb67c0098" released by "delete_volume" :: held 0.780s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-3cb25a1d-989f-485b-833f-7fd7a3df88de" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-3cb25a1d-989f-485b-833f-7fd7a3df88de" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Deleting offline snapshot 06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 of volume 3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] snapshot_file for this snap is: volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11c3e26-5bcc-4454-b70c-0cf10b712ef8]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Created reservations ['42f4e847-7c7f-4530-9ca1-50cee85353f9', '9d6a3879-4409-4f5c-981a-80ae5e589da2', '61346bcd-4451-4047-ae0d-900410ecbfa2', '32d39794-5131-44be-a44e-67614c33cea3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:56 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0
Jul 17 04:01:56 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:56 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:56 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "cinder-3cc3a26a-b178-4db4-87f2-75ac144355a5-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-3cc3a26a-b178-4db4-87f2-75ac144355a5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Lock "cinder-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "cinder-quobyte-3cc3a26a-b178-4db4-87f2-75ac144355a5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:57 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-3cc3a26a-b178-4db4-87f2-75ac144355a5" acquired by "delete_volume" :: waited 0.053s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Deleted volume successfully.
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d78141-f563-445b-b67f-d197f3f87ad9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-quobyte-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc049b8f-354f-49ee-98c2-986bb4ae5c32 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-e956e937-3e34-4c9e-8422-aa1cb67c0098-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:57 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" returned: 0 in 0.594s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cb25a1d-989f-485b-833f-7fd7a3df88de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d474fe55-4937-4af1-934b-49da7dc8213b]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f366c73-e0dc-4738-bb34-163cb0e4b610]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:57 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5
Jul 17 04:01:57 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:57 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe
Jul 17 04:01:57 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:57 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de
Jul 17 04:01:57 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:57 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:57 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5
Jul 17 04:01:57 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:57 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:57 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de" returned: 0 in 0.488s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:57 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe
Jul 17 04:01:57 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:57 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0
Jul 17 04:01:57 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:57 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cc3a26a-b178-4db4-87f2-75ac144355a5" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-quobyte-3cc3a26a-b178-4db4-87f2-75ac144355a5" released by "delete_volume" :: held 0.814s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Created reservations ['b50a548f-fdbd-496f-ae73-09dd43cea27b', '2a297658-d9b6-4c39-99ef-2288371f39e1', '7678bb7c-2bc5-40f5-9e99-9122bbd07477', '677d899c-13ed-469f-b98b-c2dbc92c8fae'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:58 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe" released by "delete_volume" :: held 0.864s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Created reservations ['a7d565ae-a4b4-40f2-8094-3565eb227aa9', '635dba89-ba2e-4525-9aab-07d00340f393', 'a3a0a017-17a5-4db6-b7f1-e1474aeb8ee7', 'bd6b55f8-0454-43d3-89e6-eb301be1b59d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:58 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:58 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" returned: 0 in 0.513s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:58 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:58 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0
Jul 17 04:01:58 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:58 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:01:58 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:01:58 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de.06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:58 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0" released by "_delete_snapshot" :: held 1.988s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-3cb25a1d-989f-485b-833f-7fd7a3df88de" released by "delete_snapshot" :: held 2.017s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Deleted volume successfully.
Jul 17 04:01:58 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:01:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Deleted volume successfully.
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b79702bc-1381-4e10-9767-1dc382730e46 tempest-CinderUnicodeTest-1511981255 None] Lock "cinder-3cc3a26a-b178-4db4-87f2-75ac144355a5-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fa558064-842c-46fc-80e3-c4a92d4981e8 tempest-ProjectReaderTests-176154084 None] Lock "cinder-ec60fe06-b54f-40ed-8efc-a8fdf7888bbe-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Created reservations ['25a23dc2-3e81-4765-8c98-4a22058b8702', '5580efe5-a652-4a60-8344-f2018a1372fd', '97ada402-1111-43ad-8b07-fcd6e7b19ff3', 'dd6fe581-a810-4af4-870e-da6607ee2012'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:01:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Delete snapshot completed successfully.
Jul 17 04:01:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ab570db-352c-4bbe-bfaa-57866b5564a0 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-06d9dfe5-3cb1-4a6f-812c-710f6fe0d4f0-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-3cb25a1d-989f-485b-833f-7fd7a3df88de-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Lock "cinder-3cb25a1d-989f-485b-833f-7fd7a3df88de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (d078231b-ec85-4a3a-8030-053fc21ab180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bece79ff-8e92-476d-aac7-9ba3f414d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bece79ff-8e92-476d-aac7-9ba3f414d009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484757497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a16908d-0fab-4313-bf7b-2166e3e8caf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:00Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e88caf0-00f1-47ed-a2f3-a21fe127a822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e88caf0-00f1-47ed-a2f3-a21fe127a822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59d92da-a7f3-4826-bb4b-624e4db5ac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59d92da-a7f3-4826-bb4b-624e4db5ac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a16908d-0fab-4313-bf7b-2166e3e8caf5', 'volume_name': 'volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e588de-f95c-4d4e-87cf-e02d2faa6754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e588de-f95c-4d4e-87cf-e02d2faa6754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277f5aa9-f42f-4923-983e-1ef48c5d39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:01:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Volume 3a16908d-0fab-4313-bf7b-2166e3e8caf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5', 'volume_size': 1}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1484757497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a16908d-0fab-4313-bf7b-2166e3e8caf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:00Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Creating volume 3a16908d-0fab-4313-bf7b-2166e3e8caf5 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:01:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:01:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:01:59 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5 1073741824
Jul 17 04:01:59 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-3cb25a1d-989f-485b-833f-7fd7a3df88de" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-3cb25a1d-989f-485b-833f-7fd7a3df88de" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95803f31-d3a2-4ade-93d5-11b8c3c239a4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:00 devstack sudo[106263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de
Jul 17 04:02:00 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:00 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5 1073741824" returned: 0 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:00 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:00 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5
Jul 17 04:02:00 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:00 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de
Jul 17 04:02:00 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:00 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:00 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (277f5aa9-f42f-4923-983e-1ef48c5d39f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764e499c-8e18-43db-aa2b-cf20d6e666f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3cb25a1d-989f-485b-833f-7fd7a3df88de" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Volume volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5 (3a16908d-0fab-4313-bf7b-2166e3e8caf5): created successfully
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764e499c-8e18-43db-aa2b-cf20d6e666f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (d078231b-ec85-4a3a-8030-053fc21ab180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-3cb25a1d-989f-485b-833f-7fd7a3df88de" released by "delete_volume" :: held 0.754s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d81cb7b0-937c-4c39-88ed-4a2729f988d1 tempest-ProjectReaderTests-176154084 None] Created volume successfully.
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Created reservations ['59bd4c5c-a684-42dd-8029-5280f3383cdc', '3057bae0-750a-4543-a1b6-5be2c395c6f5', 'c5fda250-2c51-460b-ba3a-b22011841756', '81d58f6d-f3a3-4e37-8cc5-51b5ecdf44ee'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:00 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:00 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:01 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.291s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Deleted volume successfully.
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-98350e44-9a85-4ea9-b156-9196533b9bcf tempest-ProjectReaderTests-1863749020 None] Lock "cinder-3cb25a1d-989f-485b-833f-7fd7a3df88de-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (dc1c48c1-eda8-4e66-934c-05cfadb1fb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4383dd18-8247-4107-8267-9d3ce27a723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4383dd18-8247-4107-8267-9d3ce27a723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1238788130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:01Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f26d9c-846e-45d2-a252-34f2349f7ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3f26d9c-846e-45d2-a252-34f2349f7ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db2558a-a6d3-41f8-9a0b-6d1cf364e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db2558a-a6d3-41f8-9a0b-6d1cf364e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0', 'volume_name': 'volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549eade4-da16-4bc4-859c-2024a6c65394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549eade4-da16-4bc4-859c-2024a6c65394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f529727-8169-41d3-ba82-3ba918531392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Volume 6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0', 'volume_size': 1}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1238788130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c6dbc3ec640fca26d630ab1bd2109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:01Z,use_quota=True,user_id='93c3b864763b40439f398b4998fb83ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Creating volume 6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:01 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:01 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 1073741824
Jul 17 04:02:01 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-3a16908d-0fab-4313-bf7b-2166e3e8caf5-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Lock "cinder-3a16908d-0fab-4313-bf7b-2166e3e8caf5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:02 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 1073741824" returned: 0 in 0.499s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-quobyte-3a16908d-0fab-4313-bf7b-2166e3e8caf5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-3a16908d-0fab-4313-bf7b-2166e3e8caf5" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:02 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0
Jul 17 04:02:02 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba9d6a-a9ea-4220-b650-d3d2a75d916e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:02 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5
Jul 17 04:02:02 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:02 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f529727-8169-41d3-ba82-3ba918531392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2eaade6-8f60-4704-9e87-87a4dae6f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Volume volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 (6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0): created successfully
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2eaade6-8f60-4704-9e87-87a4dae6f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Flow 'volume_create_manager' (dc1c48c1-eda8-4e66-934c-05cfadb1fb75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3662224a-f514-4e82-8416-95d411ceef85 tempest-ProjectReaderTests-1863749020 None] Created volume successfully.
Jul 17 04:02:02 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:02 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5
Jul 17 04:02:02 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:02 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3a16908d-0fab-4313-bf7b-2166e3e8caf5" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-3a16908d-0fab-4313-bf7b-2166e3e8caf5" released by "delete_volume" :: held 0.677s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Created reservations ['f37dfb7c-46b0-40f5-84ca-f2da80a96570', '132af190-4a53-4130-b780-e5666d1b33f4', '7a773387-dd36-41e0-bbd4-0a223711983c', '9e8035d0-f904-4074-b43e-0f0ff39f3dd7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:02 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:02 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c82fed33-3b80-4dad-956f-d3ab2e1eafac tempest-ProjectAdminTests-834417222 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6883850097656, 'free_capacity_gb': 1775.6883850097656, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 17 04:02:03 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Deleted volume successfully.
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3ff2694e-e7df-43f9-ba9b-c122583e63b5 tempest-ProjectReaderTests-176154084 None] Lock "cinder-3a16908d-0fab-4313-bf7b-2166e3e8caf5-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (4a077b17-2ace-4629-ad24-1b6e68c06ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3b1c60-cd02-4527-8c65-b430c060b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3b1c60-cd02-4527-8c65-b430c060b695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624125392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852115b2-8aa6-4605-b789-b772534c0087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:04Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1e097a-0447-457c-ba45-ead560c6d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1e097a-0447-457c-ba45-ead560c6d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3bed8f-9784-4062-8159-1988126f6f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a3bed8f-9784-4062-8159-1988126f6f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852115b2-8aa6-4605-b789-b772534c0087', 'volume_name': 'volume-852115b2-8aa6-4605-b789-b772534c0087', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba1ab2a-b383-455e-9804-d79be5c19296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba1ab2a-b383-455e-9804-d79be5c19296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d85d51-56a5-4048-9fac-570030701119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Volume 852115b2-8aa6-4605-b789-b772534c0087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852115b2-8aa6-4605-b789-b772534c0087', 'volume_size': 1}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624125392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852115b2-8aa6-4605-b789-b772534c0087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f56ae7d01214df6964f05ce4c16ef17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:04Z,use_quota=True,user_id='7f44b7320ff241ebbc3bcdbef7293197',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Creating volume 852115b2-8aa6-4605-b789-b772534c0087 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:03 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:03 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087 1073741824
Jul 17 04:02:03 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:04 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087 1073741824" returned: 0 in 0.498s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:04 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087
Jul 17 04:02:04 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:04 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.774s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d85d51-56a5-4048-9fac-570030701119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852115b2-8aa6-4605-b789-b772534c0087', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dfad96-eff7-4e3b-8b17-8d7a46ee8254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Creating offline snapshot d77e934d-4672-47b7-a874-4ea2adbff8e1 of volume 6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Volume volume-852115b2-8aa6-4605-b789-b772534c0087 (852115b2-8aa6-4605-b789-b772534c0087): created successfully
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34dfad96-eff7-4e3b-8b17-8d7a46ee8254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Flow 'volume_create_manager' (4a077b17-2ace-4629-ad24-1b6e68c06ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acb13fd-d26b-4ea5-8eaa-dca492e3857a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e9c4d8dc-45fb-4c37-bd38-e5762bd63a0a tempest-ProjectReaderTests-176154084 None] Created volume successfully.
Jul 17 04:02:04 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0
Jul 17 04:02:04 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:05 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:05 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 1G
Jul 17 04:02:05 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:05 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 1G" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:05 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1
Jul 17 04:02:05 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:05 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 is being set with open permissions: ugo+rw
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:05 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1
Jul 17 04:02:05 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-852115b2-8aa6-4605-b789-b772534c0087-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Lock "cinder-852115b2-8aa6-4605-b789-b772534c0087-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Acquiring lock "cinder-quobyte-852115b2-8aa6-4605-b789-b772534c0087" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-852115b2-8aa6-4605-b789-b772534c0087" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5349c24-5d5d-45f5-9d88-723334bdb9ce]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:06 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:06 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087
Jul 17 04:02:06 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:06 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.info
Jul 17 04:02:06 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:06 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:06 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.info" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:06 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.info is being set with open permissions: ugo+rw
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:06 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087
Jul 17 04:02:06 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:06 devstack sudo[106342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.info
Jul 17 04:02:06 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:06 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-852115b2-8aa6-4605-b789-b772534c0087" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Lock "cinder-quobyte-852115b2-8aa6-4605-b789-b772534c0087" released by "delete_volume" :: held 0.717s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:06 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.info" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eef2eb9f-cdf6-43a9-a90d-b4ac9ecfece1 tempest-ProjectReaderTests-1863749020 None] Create snapshot completed successfully
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Created reservations ['530911b9-a71f-458d-b3f8-90bb9256db4a', '06fc2a5c-97f9-4389-8193-00593d884a9a', '57b8ccc6-e58b-4cfe-8d5d-6a654761b531', '98b94f0c-1ee7-4dd9-b883-74b711f87f47'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:06 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:06 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-d77e934d-4672-47b7-a874-4ea2adbff8e1-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-d77e934d-4672-47b7-a874-4ea2adbff8e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-d77e934d-4672-47b7-a874-4ea2adbff8e1" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-d77e934d-4672-47b7-a874-4ea2adbff8e1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Deleting offline snapshot d77e934d-4672-47b7-a874-4ea2adbff8e1 of volume 6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] snapshot_file for this snap is: volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:07 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Deleted volume successfully.
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7032db52-6f51-42a5-8c34-d01097a98189]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8401a868-e58b-4529-8f4d-2841381fbf40 tempest-ProjectReaderTests-176154084 None] Lock "cinder-852115b2-8aa6-4605-b789-b772534c0087-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (3841bee4-f1c5-4a23-9a67-5dacdcebc4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f84c140-eb2f-4ffc-a2cd-e5bba650c863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f84c140-eb2f-4ffc-a2cd-e5bba650c863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53237137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7313165-011a-4a50-978d-38f7be897fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:07Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fb267d-75d2-4fc8-b3f8-2b1219c3dc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:07 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fb267d-75d2-4fc8-b3f8-2b1219c3dc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:07 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ec1a5d-21fb-4a70-9ff6-d9f279cfa23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ec1a5d-21fb-4a70-9ff6-d9f279cfa23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7313165-011a-4a50-978d-38f7be897fae', 'volume_name': 'volume-a7313165-011a-4a50-978d-38f7be897fae', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d73e5e-4b17-4d16-824a-18d1341f63cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d73e5e-4b17-4d16-824a-18d1341f63cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9665300f-217f-46fa-89ac-fad1b052a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Volume a7313165-011a-4a50-978d-38f7be897fae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7313165-011a-4a50-978d-38f7be897fae', 'volume_size': 1}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53237137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7313165-011a-4a50-978d-38f7be897fae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:07Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Creating volume a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:07 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae 1073741824
Jul 17 04:02:07 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:07 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[987311c1-c18e-45d9-9c9d-692e43c69c7d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:07 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0
Jul 17 04:02:07 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:07 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae 1073741824" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:07 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae
Jul 17 04:02:07 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:07 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:08 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1
Jul 17 04:02:08 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:08 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9665300f-217f-46fa-89ac-fad1b052a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7313165-011a-4a50-978d-38f7be897fae', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465146d1-464d-4cdd-998a-a0d41c5f972a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Volume volume-a7313165-011a-4a50-978d-38f7be897fae (a7313165-011a-4a50-978d-38f7be897fae): created successfully
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (465146d1-464d-4cdd-998a-a0d41c5f972a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (3841bee4-f1c5-4a23-9a67-5dacdcebc4bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5e511fa6-7216-4814-9514-a366725aa82c tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:02:08 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:08 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1
Jul 17 04:02:08 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:08 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0.d77e934d-4672-47b7-a874-4ea2adbff8e1" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-d77e934d-4672-47b7-a874-4ea2adbff8e1" released by "_delete_snapshot" :: held 1.618s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" released by "delete_snapshot" :: held 1.642s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Created reservations ['c8619742-eb59-4d97-9d67-19925887a824', '2445f072-8ebc-483b-b6f6-67305bce49ee', 'cc564b31-7488-43f0-8afe-93675e811b21', 'c29b51c8-7944-46a4-8cbd-deb09dd68ea7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Delete snapshot completed successfully.
Jul 17 04:02:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8c2deaa4-68a6-4a9c-9436-b146d5c89419 tempest-ProjectReaderTests-1863749020 None] Lock "cinder-d77e934d-4672-47b7-a874-4ea2adbff8e1-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "cinder-quobyte-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c4814d-7269-4d2f-80d5-c754f9891114]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:09 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0
Jul 17 04:02:09 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Creating offline snapshot cb3a050a-613e-474d-b8b1-336076c28eec of volume a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:09 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f8a62-0554-4b38-bf6c-9c5d65015676]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:09 devstack sudo[106384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0
Jul 17 04:02:09 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:09 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae
Jul 17 04:02:09 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:09 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-quobyte-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0" released by "delete_volume" :: held 0.703s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Created reservations ['6d45d28f-185d-49b0-ac4e-5dd8e428abf2', '28af5da7-550e-477a-a9fc-413c6c4f5561', '97d2966d-e761-418d-aea6-53d01a66ba94', 'b64150bb-7042-4f88-9065-ef01815d89a5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:10 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:10 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec 1G
Jul 17 04:02:10 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:10 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:10 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:10 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Deleted volume successfully.
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d3c0bb8c-59f7-4af3-939f-dbf01b1d2a0b tempest-ProjectReaderTests-1863749020 None] Lock "cinder-6aa9e0c2-8aaf-4ec1-a879-0f21fea564e0-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:10 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec 1G" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7313165-011a-4a50-978d-38f7be897fae -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:10 devstack sudo[106400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7313165-011a-4a50-978d-38f7be897fae -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec
Jul 17 04:02:10 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:10 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7313165-011a-4a50-978d-38f7be897fae -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:10 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec is being set with open permissions: ugo+rw
Jul 17 04:02:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:10 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec
Jul 17 04:02:10 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:11 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:11 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.info
Jul 17 04:02:11 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:11 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.info" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:11 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.info is being set with open permissions: ugo+rw
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:11 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.info
Jul 17 04:02:11 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:11 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.info" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6cbc192a-3237-479d-81c6-1e0b8ff244cc tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-cb3a050a-613e-474d-b8b1-336076c28eec-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Lock "cinder-cb3a050a-613e-474d-b8b1-336076c28eec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-a7313165-011a-4a50-978d-38f7be897fae" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-a7313165-011a-4a50-978d-38f7be897fae" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-cb3a050a-613e-474d-b8b1-336076c28eec" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-cb3a050a-613e-474d-b8b1-336076c28eec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot cb3a050a-613e-474d-b8b1-336076c28eec of volume a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7685574-1eba-48ad-b13b-071f736fe15e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:11 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec
Jul 17 04:02:11 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:12 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7313165-011a-4a50-978d-38f7be897fae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:12 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:12 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e3bdbe-cbeb-43bb-9160-2bb97a84b1b3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:12 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae
Jul 17 04:02:12 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:12 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 04:02:12 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:12 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec
Jul 17 04:02:12 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:13 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:13 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec
Jul 17 04:02:13 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:13 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae.cb3a050a-613e-474d-b8b1-336076c28eec" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-cb3a050a-613e-474d-b8b1-336076c28eec" released by "_delete_snapshot" :: held 1.482s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-a7313165-011a-4a50-978d-38f7be897fae" released by "delete_snapshot" :: held 1.507s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Created reservations ['ca450b22-f74f-40ba-a477-233ee729cbe1', 'afe29738-85d3-43a4-87ce-c14e23620f74', 'b658d93c-3b6c-49b6-9b2c-600bce1bda95', 'c5ffa201-341d-44a0-858c-8229ad7c293a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00169d5e-0d6c-45b9-9934-34e6f9a5ec3d tempest-ProjectMemberTests-394518333 None] Lock "cinder-cb3a050a-613e-474d-b8b1-336076c28eec-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-a7313165-011a-4a50-978d-38f7be897fae-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Lock "cinder-a7313165-011a-4a50-978d-38f7be897fae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-a7313165-011a-4a50-978d-38f7be897fae" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-a7313165-011a-4a50-978d-38f7be897fae" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb16fb46-150b-49e8-8069-9ee67097be0e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:14 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae
Jul 17 04:02:14 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:14 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:14 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae
Jul 17 04:02:14 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:14 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-a7313165-011a-4a50-978d-38f7be897fae" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-a7313165-011a-4a50-978d-38f7be897fae" released by "delete_volume" :: held 0.663s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Created reservations ['44c7b238-0cd0-408e-a500-a13e029e4ab1', 'c6d79c9d-b038-4007-9b1b-0c7e85f0617f', '9abf47d7-4f1d-432a-95b6-d133f952c4b8', '4abfc798-3e8b-478e-9b9b-d859e2876c6e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:14 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:14 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:15 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a2c2908e-699f-4fb6-a248-b335b3f61962 tempest-ProjectMemberTests-394518333 None] Lock "cinder-a7313165-011a-4a50-978d-38f7be897fae-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (c3a450bd-0448-4931-9f26-f1021c114a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0c211c-affb-4ab3-b41e-18e071cbfd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0c211c-affb-4ab3-b41e-18e071cbfd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784499936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06ce306-054f-4aeb-8489-275cf5aeca33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:16Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4482fc6b-2a32-4177-8035-7f24570ca042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4482fc6b-2a32-4177-8035-7f24570ca042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d3bb75-0e72-488c-b465-b115d4f92f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d3bb75-0e72-488c-b465-b115d4f92f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f06ce306-054f-4aeb-8489-275cf5aeca33', 'volume_name': 'volume-f06ce306-054f-4aeb-8489-275cf5aeca33', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56eae76-24b7-438e-8ee7-42dd55da6958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56eae76-24b7-438e-8ee7-42dd55da6958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bd53d9-8518-4066-9e60-e0ee5be7154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Volume f06ce306-054f-4aeb-8489-275cf5aeca33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f06ce306-054f-4aeb-8489-275cf5aeca33', 'volume_size': 1}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1784499936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06ce306-054f-4aeb-8489-275cf5aeca33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:16Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Creating volume f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:15 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 1073741824
Jul 17 04:02:15 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:16 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 1073741824" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:16 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33
Jul 17 04:02:16 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:16 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bd53d9-8518-4066-9e60-e0ee5be7154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06ce306-054f-4aeb-8489-275cf5aeca33', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47e1683-0db4-4d73-abc4-6afa2f7f7e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Volume volume-f06ce306-054f-4aeb-8489-275cf5aeca33 (f06ce306-054f-4aeb-8489-275cf5aeca33): created successfully
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47e1683-0db4-4d73-abc4-6afa2f7f7e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (c3a450bd-0448-4931-9f26-f1021c114a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a6811f06-a2ac-4cf8-9468-7836e8127fe3 tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:02:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Creating offline snapshot 7764abb9-8da1-4c1b-91dc-ec9550b64280 of volume f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf211aa2-f663-48ae-9577-7fb41c5191cd]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:17 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33
Jul 17 04:02:17 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:18 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:18 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 1G
Jul 17 04:02:18 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:18 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 1G" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f06ce306-054f-4aeb-8489-275cf5aeca33 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:18 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f06ce306-054f-4aeb-8489-275cf5aeca33 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280
Jul 17 04:02:18 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:18 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f06ce306-054f-4aeb-8489-275cf5aeca33 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:18 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 is being set with open permissions: ugo+rw
Jul 17 04:02:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:18 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280
Jul 17 04:02:18 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:19 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:19 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.info
Jul 17 04:02:19 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:19 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.info" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:19 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.info is being set with open permissions: ugo+rw
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:19 devstack sudo[106480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.info
Jul 17 04:02:19 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:19 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.info" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ce33a2e5-0c9b-480a-9fba-5531639a62cc tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-7764abb9-8da1-4c1b-91dc-ec9550b64280-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Lock "cinder-7764abb9-8da1-4c1b-91dc-ec9550b64280-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-f06ce306-054f-4aeb-8489-275cf5aeca33" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-f06ce306-054f-4aeb-8489-275cf5aeca33" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-7764abb9-8da1-4c1b-91dc-ec9550b64280" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-7764abb9-8da1-4c1b-91dc-ec9550b64280" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot 7764abb9-8da1-4c1b-91dc-ec9550b64280 of volume f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f954430a-bd57-472e-863c-eb0df4060fd5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:20 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280
Jul 17 04:02:20 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:20 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f06ce306-054f-4aeb-8489-275cf5aeca33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[210640c5-4fd9-40c8-a399-02f3bc32b3d5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:20 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33
Jul 17 04:02:20 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:20 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:20 devstack sudo[106494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280
Jul 17 04:02:20 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:21 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:21 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280
Jul 17 04:02:21 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:21 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33.7764abb9-8da1-4c1b-91dc-ec9550b64280" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-7764abb9-8da1-4c1b-91dc-ec9550b64280" released by "_delete_snapshot" :: held 1.438s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-f06ce306-054f-4aeb-8489-275cf5aeca33" released by "delete_snapshot" :: held 1.461s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Created reservations ['db3056c0-c116-4c80-ba6f-8379a8e6375e', '1106fc44-9e76-4d35-9ad3-4ec68b627c58', 'd3115df7-5608-4a64-bb4f-162522f05e1b', '359b8d01-33ef-4ba6-b36b-11e30298bfa0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:02:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce5c31d0-57af-4357-8570-11fd98d73bc9 tempest-ProjectMemberTests-394518333 None] Lock "cinder-7764abb9-8da1-4c1b-91dc-ec9550b64280-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Flow 'volume_create_manager' (6f9db570-24ad-473d-ae09-0f00dd137c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d400b4d-ed8d-4d2c-bf92-f7bdc41e05ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d400b4d-ed8d-4d2c-bf92-f7bdc41e05ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592664528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fa4e9a-fb3c-413f-a136-38e9985f0162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42924c6b1f6f49c69f8002b303feecb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:22Z,use_quota=True,user_id='ed443f8c64984391a4e98c25be20a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0174d03-2028-4771-928c-209803dc7496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0174d03-2028-4771-928c-209803dc7496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a077c4-4e4c-45f8-9e62-cc35b347da3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a077c4-4e4c-45f8-9e62-cc35b347da3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fa4e9a-fb3c-413f-a136-38e9985f0162', 'volume_name': 'volume-78fa4e9a-fb3c-413f-a136-38e9985f0162', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa96699-9f15-414c-b374-b2a16ca4bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa96699-9f15-414c-b374-b2a16ca4bddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f10384-d2d3-4353-83b0-c7d8cac66bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Volume 78fa4e9a-fb3c-413f-a136-38e9985f0162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fa4e9a-fb3c-413f-a136-38e9985f0162', 'volume_size': 1}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592664528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fa4e9a-fb3c-413f-a136-38e9985f0162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42924c6b1f6f49c69f8002b303feecb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:22Z,use_quota=True,user_id='ed443f8c64984391a4e98c25be20a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Creating volume 78fa4e9a-fb3c-413f-a136-38e9985f0162 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:22 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162 1073741824
Jul 17 04:02:22 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-f06ce306-054f-4aeb-8489-275cf5aeca33-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Lock "cinder-f06ce306-054f-4aeb-8489-275cf5aeca33-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-f06ce306-054f-4aeb-8489-275cf5aeca33" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-f06ce306-054f-4aeb-8489-275cf5aeca33" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab36633-97e5-486f-8767-80e17fe4da53]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:22 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33
Jul 17 04:02:22 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:22 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162 1073741824" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:22 devstack sudo[106509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162
Jul 17 04:02:22 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:22 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:22 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33
Jul 17 04:02:22 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:22 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f10384-d2d3-4353-83b0-c7d8cac66bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fa4e9a-fb3c-413f-a136-38e9985f0162', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5faa55-b6b5-4e80-aa84-5f90e48b7913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Volume volume-78fa4e9a-fb3c-413f-a136-38e9985f0162 (78fa4e9a-fb3c-413f-a136-38e9985f0162): created successfully
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d5faa55-b6b5-4e80-aa84-5f90e48b7913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Flow 'volume_create_manager' (6f9db570-24ad-473d-ae09-0f00dd137c36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2839f8dc-82ad-4326-abfb-f9a54d48d415 tempest-ProjectReaderTests-26948873 None] Created volume successfully.
Jul 17 04:02:22 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-f06ce306-054f-4aeb-8489-275cf5aeca33" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-f06ce306-054f-4aeb-8489-275cf5aeca33" released by "delete_volume" :: held 0.704s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Created reservations ['b145fab3-9d29-4fe6-82bc-9236b877e11f', 'deeb5703-96ac-45aa-b9b2-f6697a97d65f', 'ed162610-d909-457a-b03f-f2b9978071bc', '1501b587-66d3-40e3-857d-8f5902f66369'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:23 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:23 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Acquiring lock "cinder-78fa4e9a-fb3c-413f-a136-38e9985f0162-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Lock "cinder-78fa4e9a-fb3c-413f-a136-38e9985f0162-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Acquiring lock "cinder-quobyte-78fa4e9a-fb3c-413f-a136-38e9985f0162" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Lock "cinder-quobyte-78fa4e9a-fb3c-413f-a136-38e9985f0162" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[618b6f91-ba02-4498-8497-cb076e9db2f4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:23 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ba482e95-2ca5-4cd9-8cfb-4fe2a1ce81ce tempest-ProjectMemberTests-394518333 None] Lock "cinder-f06ce306-054f-4aeb-8489-275cf5aeca33-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:23 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162
Jul 17 04:02:23 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:23 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:23 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162
Jul 17 04:02:23 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (4d37c9d0-7fba-441d-a102-7344e2a6494b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0815c9b-04ea-48b0-833d-9e0c7623e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0815c9b-04ea-48b0-833d-9e0c7623e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297052292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c161c731-c15b-4cb5-9ef7-83b0ae40f4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:24Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a29f998-2b8c-406c-93e3-bdfb045fcce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a29f998-2b8c-406c-93e3-bdfb045fcce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e055f897-783a-476a-b295-3c8bcb386fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e055f897-783a-476a-b295-3c8bcb386fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c161c731-c15b-4cb5-9ef7-83b0ae40f4e2', 'volume_name': 'volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7041994-15de-491b-8886-b8a10451eae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7041994-15de-491b-8886-b8a10451eae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35789e-694e-4afe-a90b-40cb7e17f011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Volume c161c731-c15b-4cb5-9ef7-83b0ae40f4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2', 'volume_size': 1}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297052292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c161c731-c15b-4cb5-9ef7-83b0ae40f4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:24Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Creating volume c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:23 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 1073741824
Jul 17 04:02:23 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:23 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-78fa4e9a-fb3c-413f-a136-38e9985f0162" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Lock "cinder-quobyte-78fa4e9a-fb3c-413f-a136-38e9985f0162" released by "delete_volume" :: held 0.727s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Created reservations ['9f5e9172-9b91-4be1-a2f1-484e82241ab8', '8bd1806b-2335-4f2a-b96f-815b118bdba7', '2d6e73e7-0339-4f05-ae16-6199b8d4ab75', '629d69df-2981-4a09-83c9-adbcc3f88b32'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:24 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:24 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:24 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 1073741824" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:24 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Deleted volume successfully.
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50afa460-c3ee-43fe-9fce-eca7511ea238 tempest-ProjectReaderTests-26948873 None] Lock "cinder-78fa4e9a-fb3c-413f-a136-38e9985f0162-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:24 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2
Jul 17 04:02:24 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:24 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb35789e-694e-4afe-a90b-40cb7e17f011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dd291c-de99-4ffd-9e28-6b121c05307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Volume volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 (c161c731-c15b-4cb5-9ef7-83b0ae40f4e2): created successfully
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33dd291c-de99-4ffd-9e28-6b121c05307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (4d37c9d0-7fba-441d-a102-7344e2a6494b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-34034cf7-0629-4d65-95f4-ff98fe885582 tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Flow 'volume_create_manager' (fc819e6c-f1e6-4de3-8060-ff970c02e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6768a39-624e-4b52-af2b-04478f065d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6768a39-624e-4b52-af2b-04478f065d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499158107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35272b11-372e-4fb5-82bd-97645a16658a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42924c6b1f6f49c69f8002b303feecb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:25Z,use_quota=True,user_id='ed443f8c64984391a4e98c25be20a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506b99fc-8d58-4539-a409-9271b3e2a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506b99fc-8d58-4539-a409-9271b3e2a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbe16d8-2de5-430a-9ad0-669326b45083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbe16d8-2de5-430a-9ad0-669326b45083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35272b11-372e-4fb5-82bd-97645a16658a', 'volume_name': 'volume-35272b11-372e-4fb5-82bd-97645a16658a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568bdef9-48ba-4ceb-b2d1-dd1fa9cf0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568bdef9-48ba-4ceb-b2d1-dd1fa9cf0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f913a0f7-7a68-4627-98b3-de7e67cec0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Volume 35272b11-372e-4fb5-82bd-97645a16658a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35272b11-372e-4fb5-82bd-97645a16658a', 'volume_size': 1}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499158107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35272b11-372e-4fb5-82bd-97645a16658a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42924c6b1f6f49c69f8002b303feecb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:25Z,use_quota=True,user_id='ed443f8c64984391a4e98c25be20a929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Creating volume 35272b11-372e-4fb5-82bd-97645a16658a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:24 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a 1073741824
Jul 17 04:02:24 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:25 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a 1073741824" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:25 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a
Jul 17 04:02:25 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:25 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.664s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f913a0f7-7a68-4627-98b3-de7e67cec0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35272b11-372e-4fb5-82bd-97645a16658a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0895b75a-0aaa-40c1-8451-9cad66b949fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Creating offline snapshot b5acc137-6b72-442d-a64a-4f63345ab5a2 of volume c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Volume volume-35272b11-372e-4fb5-82bd-97645a16658a (35272b11-372e-4fb5-82bd-97645a16658a): created successfully
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0895b75a-0aaa-40c1-8451-9cad66b949fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Flow 'volume_create_manager' (fc819e6c-f1e6-4de3-8060-ff970c02e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a1e27d-3c69-4150-b83f-3221a70bea47]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9cf6bc8b-8403-4aed-9607-c7b1d9762189 tempest-ProjectReaderTests-26948873 None] Created volume successfully.
Jul 17 04:02:25 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2
Jul 17 04:02:25 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Acquiring lock "cinder-35272b11-372e-4fb5-82bd-97645a16658a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Lock "cinder-35272b11-372e-4fb5-82bd-97645a16658a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Acquiring lock "cinder-quobyte-35272b11-372e-4fb5-82bd-97645a16658a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Lock "cinder-quobyte-35272b11-372e-4fb5-82bd-97645a16658a" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5467ba-03cc-46a9-8caa-5360b4505f7d]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:26 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a
Jul 17 04:02:26 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:26 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:26 devstack sudo[106555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 1G
Jul 17 04:02:26 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:26 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:26 devstack sudo[106564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a
Jul 17 04:02:26 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:26 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 1G" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:26 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2
Jul 17 04:02:26 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:26 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-35272b11-372e-4fb5-82bd-97645a16658a" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Lock "cinder-quobyte-35272b11-372e-4fb5-82bd-97645a16658a" released by "delete_volume" :: held 0.676s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Created reservations ['023ec3cb-e222-4afa-9846-2781919a9268', '5168639b-913d-4273-a86c-f2f3c31b124e', 'dba54a72-3bd6-4755-a33c-236aa01f21f6', 'c2a2b032-2873-4094-bb1e-2a245aee707d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:26 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:26 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:26 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:26 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 is being set with open permissions: ugo+rw
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:26 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2
Jul 17 04:02:26 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:26 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Deleted volume successfully.
Jul 17 04:02:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54b6e618-7c8b-438a-87e9-96000a442a1e tempest-ProjectReaderTests-26948873 None] Lock "cinder-35272b11-372e-4fb5-82bd-97645a16658a-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:27 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:27 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.info
Jul 17 04:02:27 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:27 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.info" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:27 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.info is being set with open permissions: ugo+rw
Jul 17 04:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:27 devstack sudo[106581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.info
Jul 17 04:02:27 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:27 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.info" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5320dc41-05e6-479e-802b-59ed9b250f1f tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-b5acc137-6b72-442d-a64a-4f63345ab5a2-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Lock "cinder-b5acc137-6b72-442d-a64a-4f63345ab5a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-b5acc137-6b72-442d-a64a-4f63345ab5a2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-b5acc137-6b72-442d-a64a-4f63345ab5a2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot b5acc137-6b72-442d-a64a-4f63345ab5a2 of volume c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca0aa2-d331-4208-bee2-a281577bca7a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:28 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2
Jul 17 04:02:28 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:28 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba3e48e-9ee0-49e3-b2b3-3ab8338f5ea5]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:28 devstack sudo[106589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2
Jul 17 04:02:28 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:29 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:29 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2
Jul 17 04:02:29 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:29 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:29 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2
Jul 17 04:02:29 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:29 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2.b5acc137-6b72-442d-a64a-4f63345ab5a2" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-b5acc137-6b72-442d-a64a-4f63345ab5a2" released by "_delete_snapshot" :: held 1.415s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" released by "delete_snapshot" :: held 1.442s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Created reservations ['9089d571-727d-4754-80b2-fdc433050ce7', '18ae7b75-08dd-4e4d-a700-e54dfcc175f4', '57299246-6074-41c9-a970-6f9842a53c39', 'a87a0791-2103-476b-95a3-27d6cd49b5d1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:02:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9c55c7d2-2558-4382-be0a-10d41d856b62 tempest-ProjectMemberTests-394518333 None] Lock "cinder-b5acc137-6b72-442d-a64a-4f63345ab5a2-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Lock "cinder-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8198c128-4b45-44a8-bd44-59d12d9a6726]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:30 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2
Jul 17 04:02:30 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:30 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:30 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2
Jul 17 04:02:30 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:31 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2" released by "delete_volume" :: held 0.644s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Created reservations ['24070983-413a-4aec-906a-31e23c604e8c', '1182daff-1034-4d62-8f39-c74a85780334', 'e50952fa-9880-44b0-a870-d7879852b5a9', 'a6b17382-1081-43c0-b8d4-31439c71c884'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:31 devstack sudo[106611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:31 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:31 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-61b145ea-4b9b-40a8-b02d-067d434f3180 tempest-ProjectMemberTests-394518333 None] Lock "cinder-c161c731-c15b-4cb5-9ef7-83b0ae40f4e2-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (edcc650e-3439-4024-b60f-43ce35e55eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cb3687-48c0-44c0-a519-3a2c7d4ef181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91cb3687-48c0-44c0-a519-3a2c7d4ef181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169577276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41054979-d904-4092-b8a2-b1e4f7869ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:32Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab498032-77e6-452c-9c56-6f8215e4273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab498032-77e6-452c-9c56-6f8215e4273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e7c7cb-d2e4-453a-b0dd-bfb46e3db17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e7c7cb-d2e4-453a-b0dd-bfb46e3db17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41054979-d904-4092-b8a2-b1e4f7869ade', 'volume_name': 'volume-41054979-d904-4092-b8a2-b1e4f7869ade', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0996d9-3614-4462-b2fa-7cd06a1f1458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0996d9-3614-4462-b2fa-7cd06a1f1458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43f116-d1af-498c-b27b-47080e50b3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Volume 41054979-d904-4092-b8a2-b1e4f7869ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41054979-d904-4092-b8a2-b1e4f7869ade', 'volume_size': 1}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169577276',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41054979-d904-4092-b8a2-b1e4f7869ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:32Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Creating volume 41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:31 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade 1073741824
Jul 17 04:02:31 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:32 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade 1073741824" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=181,cinder:INSERT=60,cinder:UPDATE=237,cinder:DELETE=17 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:32 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade
Jul 17 04:02:32 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:32 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d43f116-d1af-498c-b27b-47080e50b3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41054979-d904-4092-b8a2-b1e4f7869ade', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e902edff-545e-4180-a18c-8f04c1730bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Volume volume-41054979-d904-4092-b8a2-b1e4f7869ade (41054979-d904-4092-b8a2-b1e4f7869ade): created successfully
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e902edff-545e-4180-a18c-8f04c1730bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (edcc650e-3439-4024-b60f-43ce35e55eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28929bc9-643f-4444-b57b-33ab914c1ad9 tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:INSERT=63,cinder:UPDATE=239,cinder:SELECT=176,cinder:DELETE=24 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Creating offline snapshot 5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 of volume 41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8093e93-c254-4988-92ec-fa534f698e54]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:33 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade
Jul 17 04:02:33 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:33 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:33 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 1G
Jul 17 04:02:33 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:33 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 1G" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41054979-d904-4092-b8a2-b1e4f7869ade -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:33 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41054979-d904-4092-b8a2-b1e4f7869ade -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48
Jul 17 04:02:33 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:34 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41054979-d904-4092-b8a2-b1e4f7869ade -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" returned: 0 in 0.291s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:34 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 is being set with open permissions: ugo+rw
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:34 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48
Jul 17 04:02:34 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:34 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:34 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.info
Jul 17 04:02:34 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:34 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.info" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:34 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.info is being set with open permissions: ugo+rw
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:34 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.info
Jul 17 04:02:34 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:34 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2934fd2d-abd6-4bef-b873-6eb4e6a8a255 tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Lock "cinder-5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-41054979-d904-4092-b8a2-b1e4f7869ade" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-41054979-d904-4092-b8a2-b1e4f7869ade" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot 5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 of volume 41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda6eb7-9430-4c11-a58c-36d36fbef211]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:35 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48
Jul 17 04:02:35 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:35 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41054979-d904-4092-b8a2-b1e4f7869ade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbcd11e-c4ec-4854-9170-d61f31c06a4e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:35 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade
Jul 17 04:02:35 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:35 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:36 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48
Jul 17 04:02:36 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:36 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:36 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48
Jul 17 04:02:36 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:36 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade.5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48" released by "_delete_snapshot" :: held 1.423s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-41054979-d904-4092-b8a2-b1e4f7869ade" released by "delete_snapshot" :: held 1.444s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Created reservations ['67d6b5ee-7c2a-425d-b06e-6389c685125b', '78839f2f-0f7d-4679-8577-6a61401c725f', '74913aea-fd66-439b-a20b-9003ed129401', '6bc3590c-3024-4f3a-80a4-826931c5fa46'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-01fa7674-b07d-464b-954d-b467564f0d78 tempest-ProjectMemberTests-394518333 None] Lock "cinder-5b401d86-fa2c-46ce-b8ea-76f1c3fa0e48-delete_snapshot" released by "delete_snapshot" :: held 1.570s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-41054979-d904-4092-b8a2-b1e4f7869ade-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Lock "cinder-41054979-d904-4092-b8a2-b1e4f7869ade-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-41054979-d904-4092-b8a2-b1e4f7869ade" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-41054979-d904-4092-b8a2-b1e4f7869ade" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[327371a5-8e9e-4e0f-ba2f-6a5e23271cab]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:37 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade
Jul 17 04:02:37 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:37 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:37 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade
Jul 17 04:02:37 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:38 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-41054979-d904-4092-b8a2-b1e4f7869ade" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-41054979-d904-4092-b8a2-b1e4f7869ade" released by "delete_volume" :: held 0.657s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Created reservations ['2243c27c-9b49-47fb-b483-acd1891b35d3', 'b35ee6a3-8424-4768-be46-71d9af57d461', '04c53002-a4a8-49bd-b35e-b2dfc9d7ecda', '2dc0cfe9-0edb-4f17-a29a-ad5c11135e93'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:38 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:38 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:38 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c56d981-4fb1-4d50-abc9-ce0e890d685a tempest-ProjectMemberTests-394518333 None] Lock "cinder-41054979-d904-4092-b8a2-b1e4f7869ade-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (fa8072d6-60d5-41a9-84b4-00ea979af12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2580f6-29b6-488b-a8fa-47603638eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2580f6-29b6-488b-a8fa-47603638eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694026969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:39Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ef9c70-52f5-4b94-8522-dc734d406c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ef9c70-52f5-4b94-8522-dc734d406c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4862c239-ff39-4550-8c67-8c707c8aa1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4862c239-ff39-4550-8c67-8c707c8aa1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa', 'volume_name': 'volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8b1b05-4404-4eef-9995-f964b685f055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8b1b05-4404-4eef-9995-f964b685f055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f4eba9-e432-49b2-866e-e01e1dbeeff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Volume 3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa', 'volume_size': 1}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694026969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:39Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Creating volume 3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:39 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa 1073741824
Jul 17 04:02:39 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:39 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa 1073741824" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:39 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa
Jul 17 04:02:39 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:39 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f4eba9-e432-49b2-866e-e01e1dbeeff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b68851-3075-4d98-904e-c90a6a0681d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Volume volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa (3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa): created successfully
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b68851-3075-4d98-904e-c90a6a0681d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (fa8072d6-60d5-41a9-84b4-00ea979af12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ff2cff43-10cb-4ab5-83ec-5eddce58782e tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Creating offline snapshot 576ae4cd-c507-42b2-880b-f036c69881ac of volume 3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3d5cb-3663-4f34-8575-20ebe954e753]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:40 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa
Jul 17 04:02:40 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:40 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:40 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac 1G
Jul 17 04:02:40 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:40 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac 1G" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:40 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac
Jul 17 04:02:40 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:41 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac is being set with open permissions: ugo+rw
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:41 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac
Jul 17 04:02:41 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:41 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:41 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.info
Jul 17 04:02:41 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:41 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.info" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.info is being set with open permissions: ugo+rw
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:41 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.info
Jul 17 04:02:41 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:41 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ee68cf73-5bac-41dd-b265-771a4ceaa490 tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-576ae4cd-c507-42b2-880b-f036c69881ac-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Lock "cinder-576ae4cd-c507-42b2-880b-f036c69881ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-576ae4cd-c507-42b2-880b-f036c69881ac" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-576ae4cd-c507-42b2-880b-f036c69881ac" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot 576ae4cd-c507-42b2-880b-f036c69881ac of volume 3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672cf13-84ad-4110-a616-f93206b2ae36]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:42 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac
Jul 17 04:02:42 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:42 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d2ce57-2f75-4e8e-8e31-de2082c9d2e3]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:42 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa
Jul 17 04:02:42 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:43 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:43 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac
Jul 17 04:02:43 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:43 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:43 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac
Jul 17 04:02:43 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:43 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa.576ae4cd-c507-42b2-880b-f036c69881ac" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-576ae4cd-c507-42b2-880b-f036c69881ac" released by "_delete_snapshot" :: held 1.367s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" released by "delete_snapshot" :: held 1.394s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Created reservations ['51a7c686-58cf-4b4a-9f70-8a2966be9bfe', 'b4aa2443-0173-458a-bb51-8fb99a70ab11', 'ec292d81-e80a-4412-9ffc-b82ec47bc762', '9e40e014-72fe-4c8a-84c7-245e6c3c2cc3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:02:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9ae40bb2-c299-4894-afd8-49d95f02de0b tempest-ProjectMemberTests-394518333 None] Lock "cinder-576ae4cd-c507-42b2-880b-f036c69881ac-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Lock "cinder-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[59364e94-f75b-4c36-839d-3db9807a8490]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:44 devstack sudo[106771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa
Jul 17 04:02:44 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:44 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:44 devstack sudo[106776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa
Jul 17 04:02:44 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:45 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa" released by "delete_volume" :: held 0.652s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Created reservations ['b43a9a41-fc61-4415-832a-9382a9335541', 'f0d0989c-71cc-4c20-8483-4cc9e8b9cf06', '901f7a99-ed98-4796-a2da-ab35ec2034aa', '3a5efbb7-5417-4d0e-b07f-9e5589a2724e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:45 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:45 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:45 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6791f9de-1950-4304-b6c1-bfcca52a3a08 tempest-ProjectMemberTests-394518333 None] Lock "cinder-3ba38cf2-74d5-43e2-9b8a-3f6a7de436aa-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (986707c2-43d2-4185-b672-53fd73c8f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922c503-4462-4317-a43d-b4ffc22ea9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922c503-4462-4317-a43d-b4ffc22ea9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425925808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8ff5b4-dab2-4a27-829c-95f18d9ffabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:46Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50a378-0475-4489-ab41-0c6d8fe15e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f50a378-0475-4489-ab41-0c6d8fe15e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9245d4a-adf5-4069-8ba5-5a3e8d70e8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9245d4a-adf5-4069-8ba5-5a3e8d70e8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e8ff5b4-dab2-4a27-829c-95f18d9ffabe', 'volume_name': 'volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b52a8a-92eb-48ff-887a-58cf71495581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b52a8a-92eb-48ff-887a-58cf71495581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5449ba2-c121-4b2e-a95d-81e2db886ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Volume 1e8ff5b4-dab2-4a27-829c-95f18d9ffabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe', 'volume_size': 1}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-425925808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e8ff5b4-dab2-4a27-829c-95f18d9ffabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:46Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Creating volume 1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:46 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:46 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe 1073741824
Jul 17 04:02:46 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:46 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe 1073741824" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:46 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe
Jul 17 04:02:46 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:46 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5449ba2-c121-4b2e-a95d-81e2db886ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5364c2e4-33e4-457d-a449-e22d00e9bf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Volume volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe (1e8ff5b4-dab2-4a27-829c-95f18d9ffabe): created successfully
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5364c2e4-33e4-457d-a449-e22d00e9bf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (986707c2-43d2-4185-b672-53fd73c8f367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-24570862-f6d9-4c06-aa3b-3d6352133adf tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Creating offline snapshot c442a804-04d2-4546-901f-5d5d4151d521 of volume 1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a85aadb-b8b6-44e1-babb-4f37e974d848]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:47 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe
Jul 17 04:02:47 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:47 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:47 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 1G
Jul 17 04:02:47 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:47 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 1G" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:47 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521
Jul 17 04:02:47 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:48 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:48 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 is being set with open permissions: ugo+rw
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:48 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521
Jul 17 04:02:48 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:48 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:48 devstack sudo[106810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.info
Jul 17 04:02:48 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:48 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.info" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:48 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.info is being set with open permissions: ugo+rw
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:48 devstack sudo[106813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.info
Jul 17 04:02:48 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:48 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.info" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1cb35559-0d91-40d6-b6da-8241b2b3e7ad tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-c442a804-04d2-4546-901f-5d5d4151d521-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Lock "cinder-c442a804-04d2-4546-901f-5d5d4151d521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-c442a804-04d2-4546-901f-5d5d4151d521" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-c442a804-04d2-4546-901f-5d5d4151d521" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot c442a804-04d2-4546-901f-5d5d4151d521 of volume 1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e047207f-b40f-426e-94b7-085faff1195a]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:49 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521
Jul 17 04:02:49 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:49 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e2771-640b-4a6b-acc1-d55a3febbae4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:49 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe
Jul 17 04:02:49 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:50 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:50 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521
Jul 17 04:02:50 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:50 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:50 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521
Jul 17 04:02:50 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:50 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe.c442a804-04d2-4546-901f-5d5d4151d521" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-c442a804-04d2-4546-901f-5d5d4151d521" released by "_delete_snapshot" :: held 1.358s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" released by "delete_snapshot" :: held 1.379s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Created reservations ['13946442-057a-4a29-a2d6-198d22889807', 'bc7133d6-db93-4811-9cf6-ee2c7904dffe', '4bc6beb5-53ae-4c9a-ad53-301e1ed035ed', '990f489a-5367-47ad-89db-9060c2ce3af4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:02:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47dbd942-b962-41a0-94e0-085537abd985 tempest-ProjectMemberTests-394518333 None] Lock "cinder-c442a804-04d2-4546-901f-5d5d4151d521-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Lock "cinder-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0abfd93-c4e9-4be4-a255-21a22002f469]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:51 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe
Jul 17 04:02:51 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:51 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:51 devstack sudo[106845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe
Jul 17 04:02:51 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:52 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe" released by "delete_volume" :: held 0.654s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Created reservations ['50318581-b7cd-42ff-93ec-c451999a3649', 'b5cc386c-6fed-4090-bb1c-59f1d1677d69', '3b0a7088-6da0-4d4c-8d08-3741df462c43', 'ea16dc75-0d93-4220-af40-312c8b58e4b8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:52 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:52 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:52 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f0561e07-c6bc-4622-97c4-8f4ec73ebeaf tempest-ProjectMemberTests-394518333 None] Lock "cinder-1e8ff5b4-dab2-4a27-829c-95f18d9ffabe-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (f4fc013f-eada-4b73-a8f0-fef7b2ebbe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b025032b-6108-46fa-a13f-5a3785901a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b025032b-6108-46fa-a13f-5a3785901a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850150864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9e5527-8be1-4de8-938a-ec0a45c21e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:53Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd7862a-a9a7-45b3-bf12-d534dd7a2d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd7862a-a9a7-45b3-bf12-d534dd7a2d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02539201-89b4-4b55-8caa-4208c022d569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02539201-89b4-4b55-8caa-4208c022d569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9e5527-8be1-4de8-938a-ec0a45c21e74', 'volume_name': 'volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b57ab2a-cc1d-434f-80ae-bbecf82c26ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b57ab2a-cc1d-434f-80ae-bbecf82c26ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491f71c8-a2ed-4fc3-9e81-5e2a4d2c9647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Volume 9d9e5527-8be1-4de8-938a-ec0a45c21e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74', 'volume_size': 1}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850150864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9e5527-8be1-4de8-938a-ec0a45c21e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:02:53Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Creating volume 9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:53 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 1073741824
Jul 17 04:02:53 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:53 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 1073741824" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:53 devstack sudo[106858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74
Jul 17 04:02:53 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:53 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491f71c8-a2ed-4fc3-9e81-5e2a4d2c9647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77c0eb0-e5f9-4fe4-8f11-3060a4da7fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Volume volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 (9d9e5527-8be1-4de8-938a-ec0a45c21e74): created successfully
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77c0eb0-e5f9-4fe4-8f11-3060a4da7fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (f4fc013f-eada-4b73-a8f0-fef7b2ebbe95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f8df58aa-5f76-4f0c-8a71-f2940a165a3e tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Creating offline snapshot fb4419f9-b99a-4edb-8985-8668f322ece4 of volume 9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ddf9ab-f768-47ac-a4af-0ad8e548a52e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:54 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74
Jul 17 04:02:54 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:54 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:54 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 1G
Jul 17 04:02:54 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:54 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 1G" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:54 devstack sudo[106871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4
Jul 17 04:02:54 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:55 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 is being set with open permissions: ugo+rw
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:55 devstack sudo[106876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4
Jul 17 04:02:55 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:55 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:55 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.info
Jul 17 04:02:55 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:55 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.info" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:55 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.info is being set with open permissions: ugo+rw
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:55 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.info
Jul 17 04:02:55 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:55 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.info" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-568a0aa5-aaf9-44b5-b7b0-0452d8c22a99 tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-fb4419f9-b99a-4edb-8985-8668f322ece4-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Lock "cinder-fb4419f9-b99a-4edb-8985-8668f322ece4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-9d9e5527-8be1-4de8-938a-ec0a45c21e74" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-9d9e5527-8be1-4de8-938a-ec0a45c21e74" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-fb4419f9-b99a-4edb-8985-8668f322ece4" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-fb4419f9-b99a-4edb-8985-8668f322ece4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot fb4419f9-b99a-4edb-8985-8668f322ece4 of volume 9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[73715d62-457e-44f1-82b9-e90c4718380c]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:56 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4
Jul 17 04:02:56 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:56 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b3a06e-b710-4f2a-8049-8cfdc6e4343e]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:56 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74
Jul 17 04:02:56 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:56 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:57 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4
Jul 17 04:02:57 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:57 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:57 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4
Jul 17 04:02:57 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:57 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74.fb4419f9-b99a-4edb-8985-8668f322ece4" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-fb4419f9-b99a-4edb-8985-8668f322ece4" released by "_delete_snapshot" :: held 1.373s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-9d9e5527-8be1-4de8-938a-ec0a45c21e74" released by "delete_snapshot" :: held 1.393s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Created reservations ['d90f9984-db94-4bcb-80a9-92e04dc31a74', 'b96f60bd-a4be-4971-b9a9-3b5b4287ff20', 'a4681fc6-9b4a-4873-ba72-2eb4b646e402', 'c8389d8f-9891-4775-a34d-9f4cd2a36c1f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:02:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199e1f50-5298-498d-9791-539fab9ca6ac tempest-ProjectMemberTests-394518333 None] Lock "cinder-fb4419f9-b99a-4edb-8985-8668f322ece4-delete_snapshot" released by "delete_snapshot" :: held 1.516s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-9d9e5527-8be1-4de8-938a-ec0a45c21e74-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Lock "cinder-9d9e5527-8be1-4de8-938a-ec0a45c21e74-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-9d9e5527-8be1-4de8-938a-ec0a45c21e74" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-9d9e5527-8be1-4de8-938a-ec0a45c21e74" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a499e981-7b9f-4de4-b4b6-618da78548c0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:58 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74
Jul 17 04:02:58 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:58 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:58 devstack sudo[106909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74
Jul 17 04:02:58 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:59 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-9d9e5527-8be1-4de8-938a-ec0a45c21e74" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-9d9e5527-8be1-4de8-938a-ec0a45c21e74" released by "delete_volume" :: held 0.656s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Created reservations ['ae51fdc6-f31e-4352-850e-a75da77874ed', '3a9534b5-96aa-40c9-a031-62a29a84c225', 'f7327426-b7c5-42ec-ac5e-bfb79043f683', '502201d3-4001-4192-b95d-06aee24cb127'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:02:59 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:02:59 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:02:59 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:02:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1304d690-756a-49ab-b761-3b100d42dbac tempest-ProjectMemberTests-394518333 None] Lock "cinder-9d9e5527-8be1-4de8-938a-ec0a45c21e74-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (9ffdd916-0b4a-4fcc-843a-ee78e22ecd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b61ba-0871-4829-8813-ad7c75fe7ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b61ba-0871-4829-8813-ad7c75fe7ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347584804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688241d8-638e-4a38-9501-d37fdbcf6093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:03:00Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec20ee97-b0c7-461d-97e5-09b651c5b8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec20ee97-b0c7-461d-97e5-09b651c5b8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862b8f76-c359-47ac-af4f-5a9337a784f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862b8f76-c359-47ac-af4f-5a9337a784f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '688241d8-638e-4a38-9501-d37fdbcf6093', 'volume_name': 'volume-688241d8-638e-4a38-9501-d37fdbcf6093', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f3eee4-3866-4cc1-843e-68d0177f2c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f3eee4-3866-4cc1-843e-68d0177f2c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc18179-d70f-4159-885f-127af3b1f1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:02:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Volume 688241d8-638e-4a38-9501-d37fdbcf6093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-688241d8-638e-4a38-9501-d37fdbcf6093', 'volume_size': 1}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347584804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688241d8-638e-4a38-9501-d37fdbcf6093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:03:00Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Creating volume 688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:02:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:02:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:00 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 1073741824
Jul 17 04:03:00 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:00 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 1073741824" returned: 0 in 0.388s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:00 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093
Jul 17 04:03:00 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:00 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfc18179-d70f-4159-885f-127af3b1f1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-688241d8-638e-4a38-9501-d37fdbcf6093', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8979de2c-71ac-4b0c-b53f-e4fb6a8f77da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:03:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Volume volume-688241d8-638e-4a38-9501-d37fdbcf6093 (688241d8-638e-4a38-9501-d37fdbcf6093): created successfully
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8979de2c-71ac-4b0c-b53f-e4fb6a8f77da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (9ffdd916-0b4a-4fcc-843a-ee78e22ecd03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:03:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f46c37d7-3200-44d7-909b-b9fad835f1c7 tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Creating offline snapshot 72769008-b099-476e-8167-69205bd1eae2 of volume 688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[82698ee0-598b-4dee-bf54-27fea3d57f24]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:01 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093
Jul 17 04:03:01 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:01 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:01 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 1G
Jul 17 04:03:01 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:01 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 1G" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-688241d8-638e-4a38-9501-d37fdbcf6093 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:01 devstack sudo[106935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-688241d8-638e-4a38-9501-d37fdbcf6093 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2
Jul 17 04:03:01 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:02 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-688241d8-638e-4a38-9501-d37fdbcf6093 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 is being set with open permissions: ugo+rw
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:02 devstack sudo[106940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2
Jul 17 04:03:02 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:02 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:02 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.info
Jul 17 04:03:02 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:02 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.info" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.info is being set with open permissions: ugo+rw
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:02 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.info
Jul 17 04:03:02 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:02 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.info" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.802s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-59dc3414-90a2-462b-8ed3-ec69a7a8cd90 tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-72769008-b099-476e-8167-69205bd1eae2-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-72769008-b099-476e-8167-69205bd1eae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-688241d8-638e-4a38-9501-d37fdbcf6093" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-688241d8-638e-4a38-9501-d37fdbcf6093" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-72769008-b099-476e-8167-69205bd1eae2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-72769008-b099-476e-8167-69205bd1eae2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot 72769008-b099-476e-8167-69205bd1eae2 of volume 688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db10c76-0233-4adf-a7ba-39740e8d51a0]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:03 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2
Jul 17 04:03:03 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:03 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-688241d8-638e-4a38-9501-d37fdbcf6093(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b7fa2-9d44-45da-95cf-5114b90801b9]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:03 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093
Jul 17 04:03:03 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:04 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:04 devstack sudo[106960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2
Jul 17 04:03:04 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:04 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:04 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2
Jul 17 04:03:04 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:04 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093.72769008-b099-476e-8167-69205bd1eae2" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-72769008-b099-476e-8167-69205bd1eae2" released by "_delete_snapshot" :: held 1.390s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-688241d8-638e-4a38-9501-d37fdbcf6093" released by "delete_snapshot" :: held 1.409s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Created reservations ['c7d1159d-1b56-43c7-915d-5fc2167f1434', 'ad7908ea-a978-42de-aca2-0f68f42eebe9', 'eb7500da-2094-4ebc-87f3-789744bbf002', '059c5475-4fb2-41a9-950e-5db7234aa989'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:03:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:03:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bb16a53-2014-48c6-992a-9146154af6d5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-72769008-b099-476e-8167-69205bd1eae2-delete_snapshot" released by "delete_snapshot" :: held 1.543s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-688241d8-638e-4a38-9501-d37fdbcf6093-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-688241d8-638e-4a38-9501-d37fdbcf6093-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-688241d8-638e-4a38-9501-d37fdbcf6093" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-688241d8-638e-4a38-9501-d37fdbcf6093" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[00193bd5-f0b3-4f01-9ff5-b334a84cb160]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:05 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093
Jul 17 04:03:05 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:05 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:05 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093
Jul 17 04:03:05 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:06 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-688241d8-638e-4a38-9501-d37fdbcf6093" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-688241d8-638e-4a38-9501-d37fdbcf6093" released by "delete_volume" :: held 0.638s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Created reservations ['3acb5397-7179-4876-806e-9abae74477f3', '5deacfcd-bad1-4877-a447-834ad1e6e068', '0aa01036-0a4e-4389-8df5-f0549a05d0d0', 'cb836cef-b02d-4298-a8d9-4a2b853cf908'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:06 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:03:06 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:06 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:03:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f12923a3-ecc7-4e8b-a21d-deaf0bb0cda5 tempest-ProjectMemberTests-394518333 None] Lock "cinder-688241d8-638e-4a38-9501-d37fdbcf6093-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (03b2256c-ec09-4147-8c84-4f5a91c17e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9798fc6-74a0-4e52-9e80-e7f9cc46420d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9798fc6-74a0-4e52-9e80-e7f9cc46420d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16489541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88715b4e-ba03-4f52-bb5f-1e3e49cf2191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:03:07Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0549b505-3e7d-4eab-8650-eef891081b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0549b505-3e7d-4eab-8650-eef891081b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e1d55e-f44c-4ff5-b25d-e391cf92eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e1d55e-f44c-4ff5-b25d-e391cf92eeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88715b4e-ba03-4f52-bb5f-1e3e49cf2191', 'volume_name': 'volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30116818-8629-4142-8364-d92389fbc6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30116818-8629-4142-8364-d92389fbc6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0d4dce-c13f-4cde-8eb6-a9e567e3418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:03:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Volume 88715b4e-ba03-4f52-bb5f-1e3e49cf2191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191', 'volume_size': 1}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x70b28d52a600>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-17T02:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-16489541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88715b4e-ba03-4f52-bb5f-1e3e49cf2191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1298c66dbfce4aeeab2aa8ae84131765',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-17T02:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-17T02:03:07Z,use_quota=True,user_id='c47259f604b947a39726afc20496d080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91330470-03a6-449a-8a84-ad41d9693b70),volume_type_id=91330470-03a6-449a-8a84-ad41d9693b70)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Creating volume 88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:03:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Selected osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5 as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}}
Jul 17 04:03:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] casted to osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:07 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 1073741824
Jul 17 04:03:07 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:07 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 1073741824" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:07 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191
Jul 17 04:03:07 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:07 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0d4dce-c13f-4cde-8eb6-a9e567e3418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d4e732-157a-4d25-97ba-d8d257da501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 17 04:03:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Volume volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 (88715b4e-ba03-4f52-bb5f-1e3e49cf2191): created successfully
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d4e732-157a-4d25-97ba-d8d257da501c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 17 04:03:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Flow 'volume_create_manager' (03b2256c-ec09-4147-8c84-4f5a91c17e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 17 04:03:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1bad43ef-fa7f-4404-9ef1-2a1bbe612c0f tempest-ProjectMemberTests-394518333 None] Created volume successfully.
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Creating offline snapshot e237336b-49f8-476f-867e-6ac504e719e0 of volume 88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84fd92d-5307-48bf-8dd1-a8009a6d7fec]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:08 devstack sudo[106991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191
Jul 17 04:03:08 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:08 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:08 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 1G
Jul 17 04:03:08 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:08 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 1G" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:08 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0
Jul 17 04:03:08 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:09 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 -F qcow2 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 is being set with open permissions: ugo+rw
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:09 devstack sudo[107006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0
Jul 17 04:03:09 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:09 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:09 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.info
Jul 17 04:03:09 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:09 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.info" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.info is being set with open permissions: ugo+rw
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:09 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.info
Jul 17 04:03:09 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:09 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.info" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-acf8acc8-118f-4408-9667-531f9529dc98 tempest-ProjectMemberTests-394518333 None] Create snapshot completed successfully
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-e237336b-49f8-476f-867e-6ac504e719e0-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Lock "cinder-e237336b-49f8-476f-867e-6ac504e719e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-e237336b-49f8-476f-867e-6ac504e719e0" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-e237336b-49f8-476f-867e-6ac504e719e0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Deleting offline snapshot e237336b-49f8-476f-867e-6ac504e719e0 of volume 88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] snapshot_file for this snap is: volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb0422-55cc-4643-b242-c837edf1f517]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:10 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0
Jul 17 04:03:10 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:10 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[95231fc6-30f7-455e-9553-9226808a6fb4]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:10 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191
Jul 17 04:03:10 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:11 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:11 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0
Jul 17 04:03:11 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:11 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:11 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0
Jul 17 04:03:11 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:11 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191.e237336b-49f8-476f-867e-6ac504e719e0" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-e237336b-49f8-476f-867e-6ac504e719e0" released by "_delete_snapshot" :: held 1.358s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" released by "delete_snapshot" :: held 1.380s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Created reservations ['4d6d1cf9-7372-47c2-9fa7-3807ed30a21d', '5ed544c6-be58-4c38-b8c9-f0aed247dd51', '22d1540b-d3ea-4057-a4ab-3f39b4a9848f', '8ed85636-9a72-4dd2-8de6-2706c5bffffd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:03:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Delete snapshot completed successfully.
Jul 17 04:03:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6988a69f-ccce-4a78-baeb-a28320a1a476 tempest-ProjectMemberTests-394518333 None] Lock "cinder-e237336b-49f8-476f-867e-6ac504e719e0-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:12 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:03:12 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-88715b4e-ba03-4f52-bb5f-1e3e49cf2191-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Lock "cinder-88715b4e-ba03-4f52-bb5f-1e3e49cf2191-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:12 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Acquiring lock "cinder-quobyte-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-02739ea3-f48e-4722-9d99-1602bff80ddc None None] thread info: [<_MainThread(MainThread, started 123912288690304)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123912189738112)>, <Thread(Thread-3 (stat_writer), started daemon 123912176394368)>, <Thread(Rabbit-heartbeat, started daemon 123912176344448)>, <Thread(Thread-5 (_runner), started daemon 123912175244032)>, <Thread(Thread-7 (_runner), started daemon 123912175273024)>, <Thread(fd_logger, started daemon 123912173236736)>, <Thread(privsep_reader, started daemon 123912173224192)>, <Thread(tpool_thread_0, started daemon 123912164406976)>, <Thread(tpool_thread_1, started daemon 123912156014272)>, <Thread(tpool_thread_2, started daemon 123912147605184)>, <Thread(tpool_thread_3, started daemon 123912139196096)>, <Thread(tpool_thread_4, started daemon 123912130787008)>, <Thread(tpool_thread_5, started daemon 123912122377920)>, <Thread(tpool_thread_6, started daemon 123912113968832)>, <Thread(tpool_thread_7, started daemon 123912105559744)>, <Thread(tpool_thread_8, started daemon 123912097150656)>, <Thread(tpool_thread_9, started daemon 123912088741568)>, <Thread(tpool_thread_10, started daemon 123912080332480)>, <Thread(tpool_thread_11, started daemon 123912071923392)>, <Thread(tpool_thread_12, started daemon 123912063514304)>, <Thread(tpool_thread_13, started daemon 123912055105216)>, <Thread(tpool_thread_14, started daemon 123912046696128)>, <Thread(tpool_thread_15, started daemon 123912038287040)>, <Thread(tpool_thread_16, started daemon 123912029877952)>, <Thread(tpool_thread_17, started daemon 123912021468864)>, <Thread(tpool_thread_18, started daemon 123912013059776)>, <Thread(tpool_thread_19, started daemon 123912004650688)>] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[134ad99d-eb59-4fe1-b5ea-0f1a41ef3422]: (4, 'qcow2') {{(pid=88435) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:12 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191
Jul 17 04:03:12 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:12 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:12 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191
Jul 17 04:03:12 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:13 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad/volume-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Lock "cinder-quobyte-88715b4e-ba03-4f52-bb5f-1e3e49cf2191" released by "delete_volume" :: held 0.637s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Created reservations ['05eee398-8604-4631-8fcd-716e6b3f8508', '68321fc9-27ee-48e3-824c-f4b40fc0814a', '20616c65-bd71-4d7c-933b-423d7e07aa92', '46f74317-5bd8-435d-a398-38f83ccc6d5c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e54e5823-8cab-4e40-8a54-050d2c4389b5'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 17 04:03:13 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad
Jul 17 04:03:13 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 17 04:03:13 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a9fd55ac9f0f6e8f79abea12113e71ad" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 17 04:03:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Deleted volume successfully.
Jul 17 04:03:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b1cf981f-33c0-46fe-9b19-4a7866af4fc2 tempest-ProjectMemberTests-394518333 None] Lock "cinder-88715b4e-ba03-4f52-bb5f-1e3e49cf2191-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 17 04:03:23 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=105,cinder:SELECT=82,cinder:INSERT=34,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 17 04:03:23 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=106,cinder:SELECT=82,cinder:DELETE=11,cinder:INSERT=25 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}